Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS us-east-1 outage

status.aws.amazon.com

Post reply on HN
Print view View original

801–810 of 1001 posts

Re: AWS us-east-1 outage

#801

Post by naikrovek »

stfp wrote: post #758
boldman wrote: post #691

I think now is a good time to reiterate the danger of companies just throwing all of their operational resilience and sustainability over the wall and trusting someone else with their entire existence. It's wild to me that so many high performing businesses simply don't have a plan for when the cloud goes down. Some of my contacts are telling me that these outages have teams of thousands of people completely prevente…

> tens of million dollars of profit are simply vanishing vanishing or delayed six hours? I mean

money people think of money very weirdly. when they predict they will get more than they actually get, they call it "loss" for some reason, and when they predict they will get less than they actually get, it's called ... well I don't know what that's called but everyone gets bonuses.

Re: AWS us-east-1 outage

#802

Post by PopeUrbanX »

kortex wrote: post #254
zegl wrote: post #13

I love that every time this happens, 100% of the services on https://status.aws.amazon.com are green.

It's like trying to get the truth out of a kid that caused some trouble. Mom: Alexa, did you break something? Alexa: No. M: Really? What's this? 500 Internal server error A: ok maybe management console is down M: Anything else? A: ... A: ... ok maybe cloudwatch logs M: Ah hah. What else? A: That's it, I swear! M: 503 ClientError A: ...well okay secretsmanager might be busted too...

The very expensive EC2 instance I started this morning still works. Of course now I can't shut it down.

Re: AWS us-east-1 outage

#803

Post by skapadia »

skapadia wrote: post #782

I'm absolutely terrified by our reliance on cloud providers (and modern technology, networks, satellites, electric grids, etc. in general), but the cloud hasn't been around that long. It is advancing extremely fast, and every problem makes it more resilient.

IMO, the cloud is not the overall problem. Our insatiable desire to want things right HERE, right NOW is the core issue. The cloud is just a solution to try to meet that demand.

Re: AWS us-east-1 outage

#804

Post by lostlogin »

bb88 wrote: post #779
george3d6 wrote: post #765

Earlier quoted context omitted.

This seems like an insane stance to have, it's like saying businesses should ship their own stock, using their own drivers, and their in-house made cars and planes and in-house trained pilots. Heck, why stop at having servers on-site? Cast your own silicon waffers, after all you don't want spectrum exploits. Because you are worst at it. If a specialist is this bad, and the market is fully open, then it's because the…

Apple created their own silicon. Fedex uses its own pilots. The USPS uses it's own cars. If you're a company relying upon AWS for your business, is it okay if you're down for a day, or two while you wait for AWS to resolve it's issue?

It’s bloody annoying when all I want to do is vacuum the floor and Roomba says nope, “active AWS incident”.

Re: AWS us-east-1 outage

#805

Post by teh_klev »

bb88 wrote: post #779
george3d6 wrote: post #765

Earlier quoted context omitted.

This seems like an insane stance to have, it's like saying businesses should ship their own stock, using their own drivers, and their in-house made cars and planes and in-house trained pilots. Heck, why stop at having servers on-site? Cast your own silicon waffers, after all you don't want spectrum exploits. Because you are worst at it. If a specialist is this bad, and the market is fully open, then it's because the…

Apple created their own silicon. Fedex uses its own pilots. The USPS uses it's own cars. If you're a company relying upon AWS for your business, is it okay if you're down for a day, or two while you wait for AWS to resolve it's issue?

> Apple created their own silicon

Apple designed their own silicon, a third party manufactures and packages it for them.

Re: AWS us-east-1 outage

#806

Post by johannes1234321 »

george3d6 wrote: post #765
boldman wrote: post #691

I think now is a good time to reiterate the danger of companies just throwing all of their operational resilience and sustainability over the wall and trusting someone else with their entire existence. It's wild to me that so many high performing businesses simply don't have a plan for when the cloud goes down. Some of my contacts are telling me that these outages have teams of thousands of people completely prevente…

This seems like an insane stance to have, it's like saying businesses should ship their own stock, using their own drivers, and their in-house made cars and planes and in-house trained pilots. Heck, why stop at having servers on-site? Cast your own silicon waffers, after all you don't want spectrum exploits. Because you are worst at it. If a specialist is this bad, and the market is fully open, then it's because the…

the benefit of self hosting is, that you are up, while a your competitors are down.

However if youbare on AWS many of your competitors are down while you are down, so they can't takeover your business.

Re: AWS us-east-1 outage

#807

Post by dylan604 »

arksingrad wrote: post #773
lordnacho wrote: post #711

Earlier quoted context omitted.

If you did that some clever person would set up their PiHole so that their device just always worked, and then you couldn't send them ads and surveil them. They'd tell their friends and then everyone would just use their local devices locally. Totally irresponsible what you're suggesting.

this is why everyone runs piholes and no one sees ads on the internet anymore, which killed the internet ad industry

Dear person from the future, can you give me a hint on who wins the upcoming sporting events? I'm asking for a friend of course

Re: AWS us-east-1 outage

#808

Post by uranium »

chucknthem wrote: post #777
uranium wrote: post #755

Earlier quoted context omitted.

Because the expected value of using AWS is greater than the expected value of self-hosting. It's not that nobody's ever heard of running on their own metal. Look back at what everyone did before AWS, and how fast they ran screaming away from it as soon as they could. Once you didn't have to do that any more, it's just so much better that the rare outages are worth it for the vast majority of startups. Medical devices…

Agree with your first point. On the second though, at some point, infrastructure like AWS are going to be more reliable than what many banks, medical device operators etc can provide themselves. asking them to stay on their own hardware is asking for that industry to remain slow, bespoke and expensive.

Agreed, and it'll be a gradual switch rather than a single point, smeared across industries. Likely some operations won't ever go over, but it'll be a while before we know.

Re: AWS us-east-1 outage

#809

Post by SkyPuncher »

skapadia wrote: post #782

I'm absolutely terrified by our reliance on cloud providers (and modern technology, networks, satellites, electric grids, etc. in general), but the cloud hasn't been around that long. It is advancing extremely fast, and every problem makes it more resilient.

Would you prefer to have more of something good that you can't occasionally have OR less of something good that you can always have?

----

The answer likely depends on the specific thing, but I'd argue most people would take the better version of something at the risk of it not working 1 or 2 days per year.

Re: AWS us-east-1 outage

#810

Post by alfalfasprout »

jdc0589 wrote: post #481
mystcb wrote: post #213

Not sure it helps, but got this update from someone inside AWS a few moments ago. "We have identified the root cause of the issues in the US-EAST-1 Region, which is a network issue with some network devices in that Region which is affecting multiple services, including the console but also services like S3. We are actively working towards recovery."

I love how they are sharing this stuff out to some clients, but its technically under NDA.

Yeah, we got updates via NDA too lol. Such a joke that a status page update is considered privileged lol.
Post reply on HN