We just had a power outage in Ashburn starting at 10 pm Sunday night. It restored at 3:40am ish, and I know datacenters have redundant power sources but the timing is very suspicious. The AWS outage supposedly started at midnight
AWS multiple services outage in us-east-1
271–280 of 1001 posts
Re: AWS multiple services outage in us-east-1
#272There's no way it's DNS
It was DNS
Re: AWS multiple services outage in us-east-1
#273We just had a power outage in Ashburn starting at 10 pm Sunday night. It restored at 3:40am ish, and I know datacenters have redundant power sources but the timing is very suspicious. The AWS outage supposedly started at midnight
Their latest update on the status page says it's a Dynamodb DNS issue
Re: AWS multiple services outage in us-east-1
#274Coinbase down as well: https://status.coinbase.com/
Re: AWS multiple services outage in us-east-1
#275Probably makes sense to add "relies on AWS" to the criteria we're using to evaluate 3rd-party services.
Re: AWS multiple services outage in us-east-1
#276Re: AWS multiple services outage in us-east-1
#277Re: AWS multiple services outage in us-east-1
#278Their status page ( https://health.aws.amazon.com/health/status ) says the only disrupted service is DynamoDB, but it's impacting 37 other services. It is amazing to see how big a blast radius a single service can have.
Re: AWS multiple services outage in us-east-1
#279“Based on our investigation, the issue appears to be related to DNS resolution of the DynamoDB API endpoint in US-EAST-1. We are working on multiple parallel paths to accelerate recovery.” It’s always DNS.
Re: AWS multiple services outage in us-east-1
#280DynamoDB is performing fine in production in eu-central-1. Seems to be really limited to us-east-1 ( https://health.aws.amazon.com/health/status ). I think they host a lot of console and backend stuff there.