Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is S3 down?

news.ycombinator.com

Post reply on HN
Print view View original

661–670 of 1001 posts

Re: Ask HN: Is S3 down?

#661

Post by bdcravens »

Taek wrote: post #217

Mass outage like this is exactly one of the things we are looking to avoid by building a decentralized storage grid with Sia. Sia are immune to situations like this because data is stored redundantly across dozens of servers around the world that are all running on different, unique configurations. Furthermore, there's no single central point of control on the Sia network. Sia is still under heavy development, but it…

Every time there's an outage like this (AWS, Github, etc) you'll see posts about decentralizing. I consider it, then realize that getting started on decentralization will take longer than the highly reliable service's downtime I'm trying to plan for.

Re: Ask HN: Is S3 down?

#662

Post by DenisM »

alexbilbie wrote: post #503
DenisM wrote: post #459

Now might be a good time to ponder a lasting solution. Clearly, we cannot trust AWS, or any other single provider, to stay up. What is the shortest, quickest to implement, path to actual high availability? You would have to host your own software which can also fail, but then at least you could do something about it. For example, you could avoid changing things during critical times of your own business (e.g. a trade…

High availability is improved by hosting in multiple AWS regions. S3 offers alternative region replication functionality and you can use Cloudfront of another CDN to load balance between buckets

But do you always serve files from S3? Wasn't the entire S3 down today? Or was it just some regions? I couldn't even connect to s3.amazonaws.com ...

Re: Ask HN: Is S3 down?

#663

Post by [deleted] »

alexbilbie wrote: post #503
DenisM wrote: post #459

Now might be a good time to ponder a lasting solution. Clearly, we cannot trust AWS, or any other single provider, to stay up. What is the shortest, quickest to implement, path to actual high availability? You would have to host your own software which can also fail, but then at least you could do something about it. For example, you could avoid changing things during critical times of your own business (e.g. a trade…

High availability is improved by hosting in multiple AWS regions. S3 offers alternative region replication functionality and you can use Cloudfront of another CDN to load balance between buckets

[deleted]

Re: Ask HN: Is S3 down?

#665

Post by nso »

devy wrote: post #550
carbocation wrote: post #441

Earlier quoted context omitted.

People were joking about this but it turns out to be true: they host the status icons on their service: https://twitter.com/awscloud/status/836656664635846656

Due to HN's flaky Cloudflare 503 Bad Gateway error, I noticed that Cloudflare is also being affected by S3 being down in a similar but subtle way. See their status page's broken logo on the upper left hand corner.[1] It was actually directly linking to a S3 URL: https://s3.amazonaws.com/statuspage-production/pages-transac... [1]: https://www.cloudflarestatus.com/

https://www.cloudflarestatus.com/ http://www.trellostatus.com/

Looks like they are both using the same solution for their status pages. The icon for trellostatus did also fail to display.

Re: Ask HN: Is S3 down?

#666

Post by ATsch »

stretchwithme wrote: post #387
fletom wrote: post #134

what's truly incredible is that S3 has been offline for h̶a̶l̶f̶ ̶a̶n̶ ̶h̶o̶u̶r̶ two hours now and Amazon still has the audacity to put five shiny green checkmarks next to S3 on their service page. they just now put up a box at the top saying "We are investigating increased error rates for Amazon S3 requests in the US-EAST-1 Region." increased error rates? really? Amazon, everything is on fire. you are not fooling an…

What we need are status pages that are driven by votes from verified customers, which could also serve to inform the provider about issues. This would address issues that are only visible from the outside.

http://outage.report/ does this pretty much, except for the "verified customers" part.

Re: Ask HN: Is S3 down?

#667

Post by bdcravens »

nomadicactivist wrote: post #285
kangman wrote: post #59

what's the SLA for s3?

And my favourite part: "To receive a Service Credit, you must submit a claim by opening a case in the AWS Support Center." -- for a company that has built itself on automation, surely you could automate some bill credits based on the SLA.

Many companies don't give out refunds and you have to proactively request. (alas my employer's value prop, in a completely different industry of course)

Re: Ask HN: Is S3 down?

#668

Post by wsh91 »

rajangdavis wrote: post #624

Hate to ask, but does anybody now of an alternative storage solution? Also, anyone have any alternative to Heroku for now?

Google Cloud Storage (as mentioned) for storage, Google App Engine for PaaS. :)

(I work on Cloud, specifically Datastore.)

Re: Ask HN: Is S3 down?

#669

Post by sirn »

carbocation wrote: post #441
johngalt wrote: post #406

Sysadmin: I can forgive outages, but falsely reporting 'up' when you're obviously down is a heinous transgression. Somewhere a sysadmin is having to explain to a mildly technical manager that AWS services are down and affecting business critical services. That manager will be chewing out the tech because the status site shows everything is green. Dishonest metrics are worse than bad metrics for this exact reason. Any…

People were joking about this but it turns out to be true: they host the status icons on their service: https://twitter.com/awscloud/status/836656664635846656

While status icon being hosted on S3 is funny, I think it's more likely that it's not the icon itself that caused the status page to not getting updated, but rather the fault of service information (say, a JSON file) that used to generate the status page that was stored on S3. The banner could probably be configured locally, so they choose to update that for the time being (e.g. while moving the status bucket somewhere else).

Re: Ask HN: Is S3 down?

#670

Post by jasonsync »

atombender wrote: post #325

It's interesting to note the cascading effects. For example, I was immediately hit by three problems: * Slack file sharing no longer works, hangs forever (no way to hide the permanently rolling progress bar except quitting) * Github.com file uploads (e.g. dropping files into a Github issue) don't work. * Imgur.com is completely down . * Docker Hub seems to be unavailable. Can't pull/push images.

We're still up and running (Sync.com) if you need to share some files.
Post reply on HN