Amazon Web Services are down • Hacker News Board

Re: Amazon Web Services are down

#21

Post by griosa » Thu, Apr 21, 2011, 10:05 AM UTC

jedberg wrote: post #12

Yes, they are. :(

no reddit at work today!

Re: Amazon Web Services are down

#22

Post by redthrowaway » Thu, Apr 21, 2011, 10:05 AM UTC

jedberg wrote: post #13

justinsb wrote: post #9

Earlier quoted context omitted.

AWS randomize the zones per account, so "your" -1b is not necessarily the same as "my" -1b. I'm only seeing problems in my -1c. Are you seeing 3 zones failing all under the same account? If multiple AZs are down, AWS are going to have some serious explaining to do...

We (reddit) are seeing failures in all zones.

If memory serves, Amazon's reporting of what zones are experiencing problems has been...optimistic...in the past.

Re: Amazon Web Services are down

#23

Post by mathrawka » Thu, Apr 21, 2011, 10:06 AM UTC

I think this is a good example of how the "cloud" is not a silver bullet to making your site always up. AWS provides a way to keep it up, but it is up to each developer to ensure that they are using AWS in a way to make sure their site can handle problems in one availability zone.

I think we will see more of a focus from big users of AWS about focusing on how to create a redundant service using AWS. Or at least I hope we will!

Re: Amazon Web Services are down

#24

Post by jedberg » Thu, Apr 21, 2011, 10:06 AM UTC

hendi_ wrote: post #16

Yay for relying on the cloud \o/

That's like saying "yay for relying on a datacenter"

Re: Amazon Web Services are down

#25

Post by jedberg » Thu, Apr 21, 2011, 10:07 AM UTC

griosa wrote: post #21

jedberg wrote: post #12

Yes, they are. :(

no reddit at work today!

Believe me, the last thing I want is to be up at 3am working on this. I'd much rather be sleeping and letting you not work.

Re: Amazon Web Services are down

#26

Post by samratjp » Thu, Apr 21, 2011, 10:07 AM UTC

yuvadam wrote: post #2

Current status: bad things are happening in the North Virginia datacenter. EC2, EBS and RDS are all down on US-east-1. Edit: Heroku, Foursquare, Quora and Reddit are all experiencing subsequent issues.

http://status.heroku.com/ for those on Heroku

Re: Amazon Web Services are down

#27

Post by potomak » Thu, Apr 21, 2011, 10:07 AM UTC

Quora says: "We'd point fingers, but we wouldn't be where we are today without EC2."

Re: Amazon Web Services are down

#28

Post by muppetman » Thu, Apr 21, 2011, 10:08 AM UTC

hendi_ wrote: post #16

Yay for relying on the cloud \o/

Yes! It's like those dumb people that rent out 5 floors of a 100 story building, instead of building their own SkyScraper. Then, horror of horrors, 2 of the 8 lifts breaks down for 12 hours.

Such idiots for paying rent, even though building SkyScrapers isn't their core business.

Re: Amazon Web Services are down

#29

Post by guynamedloren » Thu, Apr 21, 2011, 10:08 AM UTC

yuvadam wrote: post #2

Current status: bad things are happening in the North Virginia datacenter. EC2, EBS and RDS are all down on US-east-1. Edit: Heroku, Foursquare, Quora and Reddit are all experiencing subsequent issues.

Indeed they are. Right before the issues began, I pushed a bad update to one of my Heroku apps, causing it to crash. A minute later I fixed the bug, re-pushed the git repo to Heroku... and nothing. I've been stuck with an error message on my website for hours. Unfortunate timing!

Re: Amazon Web Services are down

#30

Post by tybris » Thu, Apr 21, 2011, 10:09 AM UTC

mathrawka wrote: post #23

I think this is a good example of how the "cloud" is not a silver bullet to making your site always up. AWS provides a way to keep it up, but it is up to each developer to ensure that they are using AWS in a way to make sure their site can handle problems in one availability zone. I think we will see more of a focus from big users of AWS about focusing on how to create a redundant service using AWS. Or at least I hop…

NetFlix should sell their chaos monkey as a commercial product.