Live data from Hacker News

AWS outage shows internet users 'at mercy' of too few providers, experts say

theguardian.com

51–60 of 223 posts

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#51
post #36

Man, I did not have "AWS us-east-1 will only have TWO 9s this year" on my bingo card.

For those of us who have been using AWS for almost 20 years now, I can't imagine why anyone would willingly choose us-east-1 for anything. It is the oldest, highest traffic, most critical path region and is subject to turbulence.

It can make sense to depend on the thing that will attract massive worldwide attention if/when it goes down. Or, more likely, it's just a default people don't change.

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#54
post #5

Been a while since I worked in cloud but at least when I got out of it, the primitives where all shoring up to be generally very similar. Did multi cloud redundancy end up being too expensive? Tech didn't line up enough? No good business case? The elastic cloud story that never was? https://www.slideshare.net/slideshow/pets-vs-cattle-the-elas... What happened?

It feels like a hat on a hat, cloud systems are already designed for redundancy, adding a redundant layer on top of that is like a double condom, or invesisting in multiple investment funds.

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#55

This is what I call "fool's availability": reducing single points of failure (one cloud provider) without adding any actual redundancy. If you removed AWS/GCP/Azure/etc and just had 100 small providers scattered all over, the result would be hundreds of outages throughout the year, as opposed to one big outage every other year [in one region]. AWS is already way more reliable than any other provider. The real problem…

Yes but most of those companies aren't morons, they're just taking an acceptable risk. Multi-region or multi-cloud setup is nontrivial.

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#56
post #36

Man, I did not have "AWS us-east-1 will only have TWO 9s this year" on my bingo card.

For those of us who have been using AWS for almost 20 years now, I can't imagine why anyone would willingly choose us-east-1 for anything. It is the oldest, highest traffic, most critical path region and is subject to turbulence.

By some logic, that would mean it is the most battle-tested and highest-stakes (and therefore most carefully-managed) choice. I.e. reasons in favor.

Not that I disagree with you, but maybe not for the reasons you say (:

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#57
post #20
post #14

Earlier quoted context omitted.

Companies can architect their backends to be able to fail back to another region in case of outage, and either don't test it or don't bother to have it in place because they can just blame Amazon, and don't otherwise have an SLA for their service. To fix it, test your failback procedures. For everything else, there's nothing to fix, it's working by design.

> Companies can architect their backends to be able to fail back to another region in case of outage, and either don't test it or don't bother to have it in place because they can just blame Amazon, and don't otherwise have an SLA for their service. My CI was down for 2 hours this morning, despite not even being on AWS. We have a set of credentials on that host that we call assumeRole with and push to an S3 bucket, w…

You likely used a us-east-1 IAM endpoint instead of a regionalized one ( https://aws.amazon.com/blogs/security/how-to-use-regional-aw... ). We've been using it, and we're not experiencing any issues whatsoever in us-east-2.

One thing that AWS should do is provide an easier way to detect these hidden dependencies. You can do that with CloudTrail if you know how to do it (filter operations by region and check that none are in us-east-1), but a more explicit service would be nice.

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#59
post #26

If only there was a system of computers on the Internet that was distributed across the world where we could host things instead of all in one location. We could call it the "cloud".

We could connect distributed computers on distributed networks together using some form of internetworking protocol.

Re: AWS outage shows internet users 'at mercy' of too few providers, experts say

#60

Earlier quoted context omitted.

Also if you can't even do cross region, cross cloud won't happen

Cross region isn't simple when you have terabytes of storage in buckets in a region. Building services in other regions without that data doesn't really do any good. Maintaining instances in various regions is easy, but it's that data that complicates everything. If you need to use the instances in a different region because your main region is down, you still can't do anything because those cross region instances ca…

Bottomline is that AWS gives you the tools to survive this outage within their own ecosystem.

If there's an issue with relying only on AWS it has not been expressed in this outage.

Post reply on HN