AWS multiple services outage in us-east-1 • Hacker News Board

Re: AWS multiple services outage in us-east-1

#211

Post by froobius » Mon, Oct 20, 2025, 9:02 AM UTC

fairity wrote: post #183

As this incident unfolds, what’s the best way to estimate how many additional hours it’s likely to last? My intuition is that the expected remaining duration increases the longer the outage persists, but that would ultimately depend on the historical distribution of similar incidents. Is that kind of data available anywhere?

Yes, with no prior knowledge the mathematically correct estimate is:

time left = time so far

But as you note prior knowledge will enable a better guess.

Re: AWS multiple services outage in us-east-1

#212

Post by rirze » Mon, Oct 20, 2025, 9:02 AM UTC

We just had a power outage in Ashburn starting at 10 pm Sunday night. It restored at 3:40am ish, and I know datacenters have redundant power sources but the timing is very suspicious. The AWS outage supposedly started at midnight

Re: AWS multiple services outage in us-east-1

#213

Post by tdiff » Mon, Oct 20, 2025, 9:02 AM UTC

That strange feeling of the world getting cleaner for a while without all these dependant services.

Re: AWS multiple services outage in us-east-1

#214

Post by maximefourny » Mon, Oct 20, 2025, 9:02 AM UTC

SeanAnderson wrote: post #106

Looks like it affected Vercel, too. https://www.vercel-status.com/ My website is down :( (EDIT: website is back up, hooray)

Have you done anything for it to be back up? Looks like mines are still down.

Re: AWS multiple services outage in us-east-1

#215

Post by andrewinardeer » Mon, Oct 20, 2025, 9:02 AM UTC

Signal not working here for me in AU

Re: AWS multiple services outage in us-east-1

#216

Post by urbandw311er » Mon, Oct 20, 2025, 9:02 AM UTC

munchlax wrote: post #196

Nowadays when this happens it's always something . "Something went wrong." Even the error message itself is wrong whenever that one appears.

Displaying and propagating accurate error messages is an entire science unto itself... ...I can see why it's sometimes sensible to invest resource elsewhere and fall back to 'something'.

Re: AWS multiple services outage in us-east-1

#217

Post by moribvndvs » Mon, Oct 20, 2025, 9:03 AM UTC

So, uh, over the weekend I decided to use the fact that my company needs a status checker/page to try out Elixir + Phoenix LiveView, and just now I found out my region is down while tinkering with it and watching Final Destination. That’s a little too on the nose for my comfort.

Re: AWS multiple services outage in us-east-1

#218

Post by hobo_mark » Mon, Oct 20, 2025, 9:03 AM UTC

When did Snapchat move out of GCP?

Re: AWS multiple services outage in us-east-1

#219

Post by XCSme » Mon, Oct 20, 2025, 9:03 AM UTC

sammy2255 wrote: post #22

Can't resolve any records for dynamodb.us-east-1.amazonaws.com However, if you desperately need to access it you can force resolve it to 3.218.182.212. Seems to work for me. DNS through HN curl -v --resolve "dynamodb.us-east-1.amazonaws.com:443:3.218.182.212" https://dynamodb.us-east-1.amazonaws.com/

It's always DNS

Re: AWS multiple services outage in us-east-1

#220

Post by igleria » Mon, Oct 20, 2025, 9:03 AM UTC

funny that even if we have our app running fine in AWS europe, we are affected as developers because of npm/docker/etc being down. oh well.