Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS multiple services outage in us-east-1

health.aws.amazon.com

Post reply on HN
Print view View original

371–380 of 1001 posts

Re: AWS multiple services outage in us-east-1

#371

Post by jacquesm »

padjo wrote: post #369
jacquesm wrote: post #353

Every week or so we interview a company and ask them if they have a fall-back plan in case AWS goes down or their cloud account disappears. They always have this deer-in-the-headlights look. 'That can't happen, right?' Now imagine for a bit that it will never come back up. See where that leads you. The internet got its main strengths from the fact that it was completely decentralized. We've been systematically erodin…

Planning for an AWS outage is a complete waste of time and energy for most companies. Yes it does happen but very rarely to the tune of a few hours every 5-10 years. I can almost guarantee that whatever plans you have won’t get you fully operational faster than just waiting for AWS to fix it.

Thank you for illustrating my point. You didn't even bother to read the second paragraph.

Re: AWS multiple services outage in us-east-1

#372

Post by hvb2 »

kalleboo wrote: post #151

It's fun watching their list of "Affected Services" grow literally in front of your eyes as they figure out how many things have this dependency. It's still missing the one that earned me a phone call from a client.

In AWS, if you take out one of dynamo db, S3 or lambda you're going to be in a world of pain. Any architecture will likely use those somewhere including all the other services on top.

If in your own datacenter your storage service goes down, how much remains running

Re: AWS multiple services outage in us-east-1

#374

Post by tonyhart7 »

olex wrote: post #333
mittermayr wrote: post #129

Careful: NPM _says_ they're up ( https://status.npmjs.org/ ) but I am seeing a lot of packages not updating and npm install taking forever or never finishing. So hold off deploying now if you're dependent on that.

They've acknowledged an issue now on the status page. For me at least, it's completely down, package installation straight up doesn't work. Thankfully current work project uses a pull-through mirror that allows us to continue working.

"Thankfully current work project uses a pull-through mirror that allows us to continue working."

so there is no free coffee time???? lmao

Re: AWS multiple services outage in us-east-1

#376

Post by codeulike »

ryanmcdonough wrote: post #367

Now, I may well be naive - but isn't the point of these systems that you fail over gracefully to another data centre and no-one notices?

I get the impression that this has been thought about to some extent, but its a constantly changing architecture with new layers and new ideas being added, so for every bit of progress there's the chance of new Single Points Of Failure being added. This time it seems to be a DNS problem with DynamoDB

Re: AWS multiple services outage in us-east-1

#378

Post by sofixa »

ryanmcdonough wrote: post #347

Now, I may well be naive - but isn't the point of these systems that you fail over gracefully to another data centre and no-one notices?

> another data centre

Yes, within the same region. Doing stuff cross-region takes a little bit more effort and cost, so many skip it.

Post reply on HN