Earlier quoted context omitted.
Amazon is downplaying the problem. It is affecting many large sites.
Many large sites which aren't properly architecting their infrastructure to deal with the commodity nature of the cloud.
Amazon EC2 currently down. Affecting Heroku, Reddit, Others
161–170 of 311 posts
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#162Earlier quoted context omitted.
To be fair, AWS downtime always make the news because they affect a lot of majors websites, but that doesn't mean an average sysadmin (or devops, whatever) would do better in term of uptime with his own bay and his toys.
But this is part of the problem: we have multiple web properties, and the fact that AWS issues can affect all of them at once is a huge downside. Certainly, if we ran on metal, we would have hardware fail, but failures would be likely to be better-isolated than at Amazon.
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#163Earlier quoted context omitted.
Realistically, it's at least in part because everyone defaults to the East region. So it's the most crowded and demanding on the system.
Yeah, it's got to be much larger than the other regions, so it makes sense that we see more errors. Since error_rate = machines * error_rate_per_machine.
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#164Per the linked dashboard, some instances in a single AZ in a single Region are having storage issues. Calling EC2 "down" is a bit dramatic, provided AMZN are being sincere with their status reports. Any system that can competently fail over to another AZ will be unaffected.
I would agree with you, but Amazon is just downright dishonest in their reports, which makes me sad, because I love Amazon. Go look at the past reports, they've never shown a red market, only "degraded performance" even when services for multiple availability zones went down at the same time due to their power outage (so had you architected to multiple AZs you were still fucked). When they have a single AZ go down, t…
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#165Earlier quoted context omitted.
. . . or the problem is inherently complex.
Surely true, but that's the purpose of a system in the first place: to manage complexity and make it predictable. You could argue that we have such a system in place, given how well the Internet works overall. The fact that this system has problems goes against what I believe is fully evident proof that such a system can, in fact, work even better. We're not talking about a leap in order of magnitude of complexity he…
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#166The N. Virginia datacenter has been historically unreliable. I moved my personal projects to the West Coast (Oregon and N. California) and I have seen no significant issues in the past year. N. Virginia is both cheaper and closer to the center of mass of the developed world. I'm surprised Amazon hasn't managed to make it more reliable.
You can move your projects on demand?
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#167Maybe I'm being daft. Why does this sh*t never seem to affect www.amazon.com
Amazon doesn't run their site off the same set of EC2 servers and systems that everyone else does. They just used their experience to build it.
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#168My dashboard says "Degraded EBS performance in a single Availability Zone". It then lists each of the five zones as "Availability zone is operating normally." http://cl.ly/image/202F3B0I371g
Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#169Re: Amazon EC2 currently down. Affecting Heroku, Reddit, Others
#170What the hell is happening here?