Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon Web Services are down

status.aws.amazon.com

Post reply on HN
Print view View original

241–250 of 346 posts

Re: Amazon Web Services are down

#241

Post by wallnutboy »

blhack wrote: post #236
stef25 wrote: post #132

Earlier quoted context omitted.

Reddit's been down for several hours today, I'm sure they are already way lower 99.95%.

http://cache-scale.appspot.com/c/www.reddit.com/ That's a cache of it. I really wish that the admins at reddit would implement something like this themselves, then link to it when downtime like this happens.

They do have a read-only mode, don't they? I'm not sure why they don't enable read-only mode when things like this happen. It may be that Amazon's service being down forbids this. I dunno.

Re: Amazon Web Services are down

#243

Post by BrandonM »

asymptotic wrote: post #136
stef25 wrote: post #132

Earlier quoted context omitted.

Reddit's been down for several hours today, I'm sure they are already way lower 99.95%.

If the Reddit web server admins took availability seriously they would have chosen to deploy across more than one region. Do you disagree? Why do you disagree? I'm being honest, no snark involved in my questions.

Why does Reddit really need 99% availability? Is a customer unduly harmed or is the world even worse off if Reddit is down for a couple cumulative days per year? Is it worth the cost? Would you put up with more ads and/or pay for Reddit in order to make sure that it's available 24/7/365?

Re: Amazon Web Services are down

#244

Post by jedberg »

tedjdziuba wrote: post #193
stef25 wrote: post #132

Earlier quoted context omitted.

Reddit's been down for several hours today, I'm sure they are already way lower 99.95%.

Reddit being down is not news.

That hurts. But you're right, we've had a lot of issues.

I think the reason this is news is because it is a massive Amazon failure.

Re: Amazon Web Services are down

#245

Post by elliottcarlson »

timf wrote: post #222

Some quotes regarding how Netflix handled this without interruptions: "Netflix showed some increased latency, internal alarms went off but hasn't had a service outage." [1] "Netflix is deployed in three zones, sized to lose one and keep going. Cheaper than cost of being down." [2] [1] https://twitter.com/adrianco/status/61075904847282177 [2] https://twitter.com/adrianco/status/61076362680745984

Are they only in three zones, or three regions? Three zones would not have helped them in this particular scenario and they would have still been at risk.

And if they do mean three regions - can that cost of spanning various regions be quantified for different companies. The money spent vs money earned for Netflix may be very different compared to Quora and Reddit. At the same time, the data synchronization needs in between regions may also vastly differ for different type of companies and infrastructures thus leading to varying amount of cost to maintain a site on multiple regions.

Re: Amazon Web Services are down

#246

Post by jedberg »

[deleted] wrote: post #234
jedberg wrote: post #15

Earlier quoted context omitted.

Thankfully, no. :) But yeah, right now we're shutting everything down to try and avoid possible data corruption. Once they restore service, hopefully we'll be able to come back quickly.

[deleted]

I'm here all the time. :)

Re: Amazon Web Services are down

#247

Post by ig1 »

Given that Heroku's parent company (Salesforce) owns a cloud platform, it seems kinda inevitable now that Herkou will perhaps sooner-than-later switch back-ends (or at least use both)

Re: Amazon Web Services are down

#248

Post by tlholaday »

guynamedloren wrote: post #29
yuvadam wrote: post #2

Current status: bad things are happening in the North Virginia datacenter. EC2, EBS and RDS are all down on US-east-1. Edit: Heroku, Foursquare, Quora and Reddit are all experiencing subsequent issues.

Indeed they are. Right before the issues began, I pushed a bad update to one of my Heroku apps, causing it to crash. A minute later I fixed the bug, re-pushed the git repo to Heroku... and nothing. I've been stuck with an error message on my website for hours. Unfortunate timing!

You have my sincere sympathy.

Re: Amazon Web Services are down

#249

Post by jedberg »

pbhjpbhj wrote: post #230
acangiano wrote: post #170

Earlier quoted context omitted.

If I was Rackspace, I'd be at Reddit/Wired's headquarters already.

Didn't Jedburg say that they could reduce the failure by spending with Amazon. I wonder if Rackspace really want this particular traffic burden. It seems that if Reddit choose not to pay for the load they need then you get lot's of bad press for it ... perhaps I'm seeing it wrong. Rubbish analogy: Kinda like if I was doing a haulage business and you called out for a wheelbarrow to carry some elephants, then when the…

No, I said that we have spent all we can, and at this point we need development.

However, in this case, the outage is not because of any issues with our setup, but with Amazon.

Post reply on HN