Live data from Hacker News

Amazon Web Services are down

status.aws.amazon.com

101–110 of 346 posts

Re: Amazon Web Services are down

#101
Assuming the problem is indeed with EBS, I would say this should be a warning sign to anyone considering going with a PaaS provider, which Amazon is quickly becoming, instead of an IaaS provider like Slicehost or Linode.

The increased complexity of their offering makes it more likely that things will break, leaving you locked in.

I did a 15 minute talk on the subject, which you can check out here: http://iforum.com.ua/video-2011-tech-podsechin

EDIT: here are the slides if you can't bother watching the video http://bit.ly/eqDNei

Re: Amazon Web Services are down

#102

Earlier quoted context omitted.

Are you part of the team resolving it?

I was looking at EC2 until this! I thought you could cluster your instances across many regions and replicate blah blah blah and change your elastic ip addresses in instances like this? Is this a case that it's not being utilised or does that system not work? I appreciate you are busy right now so I'm not expecting a reply any time soon.

That is the theory, but all of our data is currently locked in the inaccessible EBS system.

I'd still say Amazon is a great place for your startup, just don't use EBS.

Re: Amazon Web Services are down

#103
post #72
post #59

Earlier quoted context omitted.

Go back to the building metaphor. Building datacenters is not our core business, so we outsource it. Much like building a building is not our core business, nor running a telephone system, so we outsource those things too. All business critical, but still outsourced.

Of course it's okay to outsource things; and it's also okay to outsource critical stuff. I'm doing that too. But, outsourced or not, critical things should be as redundant as needed, and not relying on a single point of failure. If in a hospital a life-keeping machine depends on electricity, I hope they have diesel generators available even if their outsourced power supply fails.

I think people thought they were outsourcing the job of not having a single point of failure.

Having a critical service supplied by someone does not necessarily mean there's a single point of failure, because that someone might be working to make sure there is no single point of failure.

Re: Amazon Web Services are down

#104

Earlier quoted context omitted.

Are you part of the team resolving it?

"Resolving" probably isn't the right word seeing as this is a purely amazon issue, not much they can do. I'm guessing jedberg is mostly banging his head in walls and seriously looking at alternative hosting solutions right now.

Actaully, I'm on the couch in front of the fireplace, watching old SNL, waiting patiently for Amazon to fix their shit, and figuring out how we can not use EBS anymore.

Re: Amazon Web Services are down

#105
post #82
post #67

Earlier quoted context omitted.

They better be cutting me a check too.

As an advertiser on Reddit, you guys better be cutting me a check too :) (although my app is also dead right now so not as if the advertising would do me any good...)

Send me the link to your ad (when we come back up) and I'll comp you a day.

Re: Amazon Web Services are down

#106

So do we get some credit on our AWS accounts? I haven't really read their SLA for EC2.

I did the math on it, with the downtime so far it's almost approaching the magic 99.95% barrier where everyone gets a 10% bill credit. Wouldn't that be something to light a fire under the collective arses of those in charge of keeping EBS stable.

Re: Amazon Web Services are down

#107
post #59
post #45

Earlier quoted context omitted.

Note that I've written "relying", not "hosting", meaning I'm well aware of the fact that using "the cloud" as an additional layer of capacity can be a good thing. But relying on the cloud means that you're giving up control. Power outage in your data center? Buy diesel generators next time! Faulty network card? Put in two redundant ones! AWS down? Wait and pray!

Go back to the building metaphor. Building datacenters is not our core business, so we outsource it. Much like building a building is not our core business, nor running a telephone system, so we outsource those things too. All business critical, but still outsourced.

No, building data centers is not your core business, but your core business relies on them so intimately that it makes sense (at least to some people) to have a little more direct control of your datacenter resources. Or, the have a warm-standby of some sort.

The best analogy I can make is it's like a telemarketing company. Their core business is not building/owning/maintaining PBXs, it's calling you and trying to sell you crap at diner time. However, because they cannot deliver their core product reliably without a PBX, they tend to own/maintain their phone switches. They don't order 300 simple phone lines from the local telco, they order a couple of trunks, and manage phones and call routing to fulfill their core business needs.

It's not a perfect analogy, I know, there are cost factors unaddressed, but it's the best I can come up with right now.

I'm personally a fan of cloud services for elasticity, and early stage launching. I'm not a big fan for day to day operation of a site. The model I haven't seen worked up yet, it what does this REALLY cost a site like reedit or 4sq in relation to owning/controlling more of their own infrastructure? It's quite possible the best overall business decision is to take the risk and deal with the unpredictable inevitable outages and just hope they don't last too long.

Re: Amazon Web Services are down

#109
Had our blog go down. Didn't realize it was AWS wide..did a reboot. Now I am in reboot limbo. Put an urgent ticket into Amazon. They just said they are working urgently to fix the issues. Let's see how long this goes.

Re: Amazon Web Services are down

#110

Earlier quoted context omitted.

"Resolving" probably isn't the right word seeing as this is a purely amazon issue, not much they can do. I'm guessing jedberg is mostly banging his head in walls and seriously looking at alternative hosting solutions right now.

Actaully, I'm on the couch in front of the fireplace, watching old SNL, waiting patiently for Amazon to fix their shit, and figuring out how we can not use EBS anymore.

So I was half right? Awesome!
Post reply on HN