Ask HN: Is S3 down? • Hacker News Board

Re: Ask HN: Is S3 down?

#721

Post by dcosson » Tue, Feb 28, 2017, 9:24 PM UTC

devy wrote: post #706

So S3's been down for at least 3 hours. Does AWS break this year's S3 durability & reliability promise of eleven 9s by now? [1][2] [1]: https://aws.amazon.com/s3/details/ [2]: https://en.wikipedia.org/wiki/High_availability#Percentage_c...

That's durability (data loss) not availability.

Here's [1] their official SLA. This outage so far brings them to less than 3 nines of uptime this month (43.8 minutes) but still more than 2 nines (7.2 hours) so it sounds like everyone gets 10% off their S3 bill.

Very curious if Amazon will apply this automatically or only if you complain.

Edit: from further down the same page, it looks like only if you write in to support do you get these broken SLA credits. Kind of lame since everything else about their billing is so precise and automatic.

[1] https://aws.amazon.com/s3/sla/

Re: Ask HN: Is S3 down?

#722

Post by francesco1975 » Tue, Feb 28, 2017, 9:25 PM UTC

Yes it is down

https://status.aws.amazon.com/

Half internet is down the data center in Virginia the one with the cloud is totally dead apparently. Enjoy the cloud bullshit :)

Re: Ask HN: Is S3 down?

#723

Post by foxylion » Tue, Feb 28, 2017, 9:25 PM UTC

problems wrote: post #623

emrekzd wrote: post #312

Earlier quoted context omitted.

In December 2015 I received an e-mail with the following subject line from AWS, around 4 am in the morning: "Amazon EC2 Instance scheduled for retirement" When I checked the logs it was clear the hardware failed 30 mins before they scheduled it for retirement. EC2 and root device data was gone. The e-mail also said "you may have already lost data". So I know that Amazon schedules servers for retirement after they alr…

That's completely ridiculous, get some fucking RAID Amazon. I order drives off newegg directly to my DC and I'm yet to lose data with the cheapest drives available in RAID10.

It's not just a RAID that can fail. And everyone who uses AWS should expect failures. You should build your infrastructure to handle such failures well.

Re: Ask HN: Is S3 down?

#724

Post by boulos » Tue, Feb 28, 2017, 9:25 PM UTC

danohu wrote: post #160

AndyKelley wrote: post #90

This seems like an appropriate time as any... Anyone want to list some competitors to S3? Bonus if it also provides a way to host a static website.

Backblaze's B2 is an S3 near-clone: https://www.backblaze.com/b2/cloud-storage.html I don't know about reliability, but it's a fraction of the price of S3.

As I've said previously: I love the Backblaze folks, but B2 is apparently hosted in a single building. So that's not a question of if, but when.

Disclosure: I work on Google Cloud.

Re: Ask HN: Is S3 down?

#725

Post by nicolaslem » Tue, Feb 28, 2017, 9:26 PM UTC

gtsteve wrote: post #456

mwfj wrote: post #196

Earlier quoted context omitted.

I guess their bizarre thinking is something along the lines of: "unless we have proof that noone can access the service, we won't change the indicator from green to yellow. Seriously: I don't understand why you guys stay with AWS.

> Seriously: I don't understand why you guys stay with AWS. Personally I've been using it for ages and I know most services inside and out. They do suffer downtime in some regions occasionally, but it'd be too expensive at this point to move. And who doesn't suffer downtime? You can't avoid it; you just need a plan to deal with it. For example, having a backup replica bucket in another region and the ability to quick…

Low TTL on DNS entries might do more harm than good: if your DNS provider gets seriously DDoS, being able to rely on caches can save the day.

Anyway, I agree with your conclusion.

Re: Ask HN: Is S3 down?

#726

Post by illumin8 » Tue, Feb 28, 2017, 9:26 PM UTC

all_usernames wrote: post #677

xbryanx wrote: post #135

Earlier quoted context omitted.

I'm getting the same outage in us-west-2 right now.

Our services in us-west-2 have been up the whole time. I think the problem is globally accessible APIs are impacted. As others have noted, if you can use region/AZ-specific hostnames to connect, you can get though to S3. CloudFront is faithfully serving up our existing files even from buckets in US-East.

S3 bucket creation was down in us-west-2, because it relied on us-east-1 (I expect that dependency will get fixed after this), but all S3 operations should have continued to function in us-west-2, other than cross-region replication from us-east-1.

Re: Ask HN: Is S3 down?

#727

Post by splatcollision » Tue, Feb 28, 2017, 9:27 PM UTC

I just spent the last hour trying to figure out why in the hell I can't update the function code on a lambda instance. Next time I will remember to check HN first!

Re: Ask HN: Is S3 down?

#728

Post by monksy » Tue, Feb 28, 2017, 9:27 PM UTC

atombender wrote: post #325

It's interesting to note the cascading effects. For example, I was immediately hit by three problems: * Slack file sharing no longer works, hangs forever (no way to hide the permanently rolling progress bar except quitting) * Github.com file uploads (e.g. dropping files into a Github issue) don't work. * Imgur.com is completely down . * Docker Hub seems to be unavailable. Can't pull/push images.

On the upside.. no one is stealing more data from the CloudPets thing we were talking about earlier today.

Re: Ask HN: Is S3 down?

#729

Post by Taek » Tue, Feb 28, 2017, 9:29 PM UTC

inmiseravincit wrote: post #645

Taek wrote: post #217

Mass outage like this is exactly one of the things we are looking to avoid by building a decentralized storage grid with Sia. Sia are immune to situations like this because data is stored redundantly across dozens of servers around the world that are all running on different, unique configurations. Furthermore, there's no single central point of control on the Sia network. Sia is still under heavy development, but it…

MaidSafe's SafeNetwork is a much more robust proposition. Sia and Storj could be just simple apps in the SafeNetwork. Using the Blockchain is not adequate for storage purposes, and proof of work is just as silly. MaidSafe is rewriting all the OSI layers from layer 3 and above, guaranteeing extreme resilience, security and anonymity natively, besides of being totally distributed atomically, self-healing, self-encrypte…

A cute hack that has been up and running in a fully decentralized fashion for more than 18 months. Something that MaidSafe cannot claim even after over a decade of development.

Sia certainly has less ambitious goals. But it also has a strong track record of delivering.

Re: Ask HN: Is S3 down?

#730

Post by kccqzy » Tue, Feb 28, 2017, 9:29 PM UTC

devy wrote: post #706

So S3's been down for at least 3 hours. Does AWS break this year's S3 durability & reliability promise of eleven 9s by now? [1][2] [1]: https://aws.amazon.com/s3/details/ [2]: https://en.wikipedia.org/wiki/High_availability#Percentage_c...

I don't think this has anything to do with durability & reliability (they probably haven't lost data). It's about availability.