Live data from Hacker News

Ask HN: Is S3 down?

news.ycombinator.com

691–700 of 1001 posts

Re: Ask HN: Is S3 down?

#691

A piece of hard-earned advice: us-east-1 is the worst place to set up AWS services. You're signing up for the oldest hardware and the most frequent outages. For legacy customers, it's hard to move regions, but in general, if you have the chance to choose a region other than us-east-1, do that. I had the chance to transition to us-west-2 about 18 months ago and in that time, there have been at least three us-east-1 ou…

The s3 outage covered all regions.

Re: Ask HN: Is S3 down?

#692
We are starting to see recoveries, our SES emails have mostly gone out and our data synchronization has updated 2 of our 3 feeds. Amazon has posted a message that they expect "improved error rates" in the next 45 minutes.

Re: Ask HN: Is S3 down?

#693

Well, at least our decision to split services has paid off. All of our web app infrastructure is on AWS, which is currently down, but our status page [0] is on Digital Ocean, so at least our customers can go see that we are down! A pyrrhic victory... ;) [0] - http://status.hrpartner.io EDIT UPDATE: Well, I spoke too soon - even our status page is down now, but not sure if that is linked to the AWS issues, or simply t…

HTTP 500 :(

LOL...I just got notice that our status server is down now too! Maybe DO is just a rebranded offshoot of AWS after all... :D

Re: Ask HN: Is S3 down?

#694

Well, at least our decision to split services has paid off. All of our web app infrastructure is on AWS, which is currently down, but our status page [0] is on Digital Ocean, so at least our customers can go see that we are down! A pyrrhic victory... ;) [0] - http://status.hrpartner.io EDIT UPDATE: Well, I spoke too soon - even our status page is down now, but not sure if that is linked to the AWS issues, or simply t…

Could be worse, your entire infrastructure could be hosted on Heroku.

You don't use S3 but because they do, your entire infrastructure crumbles.

Re: Ask HN: Is S3 down?

#695

Earlier quoted context omitted.

Rackspace's Cloudfiles. Does support static websites.

I use both RS Cloud Files and Google's Cloud Storage. Google's is superior in nearly every way. The only con is that it is a Google product that could be deprecated at any point in time. But, with all the acquisition stuff happening over at RS, I'd be lying if I said I wasn't worried about them killing of their cloud offering.

I worry about everything Google hosts because they have such a track record of just randomly axing products with no or little warning.

Re: Ask HN: Is S3 down?

#696

Well, at least our decision to split services has paid off. All of our web app infrastructure is on AWS, which is currently down, but our status page [0] is on Digital Ocean, so at least our customers can go see that we are down! A pyrrhic victory... ;) [0] - http://status.hrpartner.io EDIT UPDATE: Well, I spoke too soon - even our status page is down now, but not sure if that is linked to the AWS issues, or simply t…

When even the status page is down, panic.

Re: Ask HN: Is S3 down?

#697

Yup, same here. It has been a few minutes already. Wanna bet the green checkmark[1] will stay green until the incident is resolved? [1] https://status.aws.amazon.com/

It's crazy how much better the communication (including updates and status pages) is of the companies that rely on AWS than AWS' communication itself. https://status.heroku.com/incidents/1059

I feel for them. Imagine, 40 or 50 different engineering teams all responsible for updating their statuses. At this moment on the AWS status page I see random usage of the red, yellow, and green icons, even though all the status updates are "Increased error rates." What that tells me is that there's no unified communication protocol across the teams, or they're not following it. And just imagine what it's like being on the S3 team right now.

I notice even Cloudflare is starting to have problems serving up pages now.

Re: Ask HN: Is S3 down?

#699
post #459

Now might be a good time to ponder a lasting solution. Clearly, we cannot trust AWS, or any other single provider, to stay up. What is the shortest, quickest to implement, path to actual high availability? You would have to host your own software which can also fail, but then at least you could do something about it. For example, you could avoid changing things during critical times of your own business (e.g. a trade…

High availability is improved by hosting in multiple AWS regions. S3 offers alternative region replication functionality and you can use Cloudfront of another CDN to load balance between buckets

How can you use Cloudfront to point to multiple buckets? I'm pretty sure each origin needs a path and Cloudfront serves the first path that matches.

Re: Ask HN: Is S3 down?

#700
post #94

This is one of the times that I am glad to be running my own distributed object storage. I'm sure it's not as robust as Amazon, but......

What are you using?

Openstack Swift - easy to get setup and reliable. Takes a little expertise but was well worth the investment in learning it!
Post reply on HN