AWS went crashing down yesterday

[George K]

https://www.crn.com.au/news/aws-outage-takes-out-several-sites-and-services-573717

An Amazon Web Services outage has taken down several sites and services, including some of Amazon’s own, like Alexa, Ring and Prime Video.

The outage began at approximately 2:30 am AEDT Wednesday morning, and is impacting several regions across the United States and parts of Europe, according to a tweet by ThousandEyes, a business owned by Cisco that provides real-time visibility into outages.

Just before noontime, AWS reported on its service health dashboard that it is experiencing issues with multiple services — Amazon Elastic Compute Cloud, Amazon DynamoDB, Amazon Connect and AWS Management Console — in the US-EAST-1 region.

AWS said it working to restore Elastic Compute Cloud and AWS Management Console after finding the root cause of issues with both services. The cloud service provider has only acknowledged that there are API issues with DynamoDB and “degraded contact handling” with Amazon Connect.

Users at Downdetector.com have reported outages at several major websites and services, including Facebook, Disney+ and Coinbase. Amazon’s own consumer-facing services are also experiencing outages, including Amazon.com, Ring and Prime Video, according to Downdetector.com. Motherboard reported that Amazon’s own delivery infrastructure was affected by the outage.

"With it went a few little sites like Netflix and Disney+ and, oh, Amazon itself. Tens of thousands of Adele fans waiting in virtual line for pre-release tickets were not impressed when the whole thing was rescheduled, and they weren't notified by email because email services relying on AWS were also down. (Fortune)"

"Instacart, Venmo, CashApp, Roku, McDonald's app and automated kiosks, Tinder, and Delta Air Lines all went off the air." (USA Today)

"Alexa wouldn't talk to you, Kindles couldn't kindle, Roombas couldn't roomb, and Ring video doorbells couldn't burn down your house. "

Remember this:

[Axtremus]

Among the TNCR regulars, is anyone’s job or day-to-day activities affected by this AWS outage? (Apart from reading about it, have you noticed it?)

[89th]

Yeah pretty big outage yesterday, relatively speaking. Also surprising how the AWS cloud is set up... but seems to happen every year or two. It really highlights how many services are reliant on it. I'm sure a few engineers had a really bad day yesterday.

[89th]

@axtremus said in AWS went crashing down yesterday:

Among the TNCR regulars, is anyone’s job or day-to-day activities affected by this AWS outage? (Apart from reading about it, have you noticed it?)

For me, I noticed it 3 ways:

1. My Amazon app couldn't display some recent orders (I was checking on shipping status).
2. My work has a remote connection that was really slow.
3. I was doing some ServiceNow work that was also really slow or offline for a bit.

[George K]

@axtremus said in AWS went crashing down yesterday:

is anyone’s job or day-to-day activities affected by this AWS outage

I had a grocery delivery scheduled for 1-3 PM yesterday.

"We're sorry, but we've had to cancel your order. Please build another cart."

[Mik]

How can they not have a robust fail-over? I'm not understanding this at all.

[Doctor Phibes]

@axtremus said in AWS went crashing down yesterday:

(Apart from reading about it, have you noticed it?)

I didn't know anything about it, but I was at work. Busy, busy, busy.

[LuFins Dad]

@axtremus said in AWS went crashing down yesterday:

Among the TNCR regulars, is anyone’s job or day-to-day activities affected by this AWS outage? (Apart from reading about it, have you noticed it?)

When driving with Finley, I like to stream an age appropriate book on Audible for him to listen to. That wasn’t working, so I switched over to Amazon Music for him… That didn’t work either…