Live data from Hacker News

AWS S3 Having Problems Again? (Monday 12PM Pacific)

news.ycombinator.com

31–40 of 59 posts

Re: AWS S3 Having Problems Again? (Monday 12PM Pacific)

#31
The us-east-1 region gets treated differently than all other regions by AWS. Part of the reason it gets treated differently it is the default, and hence the most popular. It also doesn't help that it is on the east coast, and experiences more weather.

For the above reasons, and that I work in the SF bay area, I put everything in us-west-2. us-west-2 sometimes has it's own issues, but nothing quite at the level of us-east-1.

Re: AWS S3 Having Problems Again? (Monday 12PM Pacific)

#37

I'm risking being inflammatory here, but do people really believe that they get better uptime from AWS compared to renting dedicated servers? I feel like AWS has way too many moving parts to be stable. It's very tempting for them to reuse bits of infrastructure everywhere which increases the chances that if something goes wrong somewhere it will break your stuff. So for example, hosting instance images on S3 means th…

S3's uptime is probably an order of magnitude better than I can provide myself. From 2010-2011 I worked with a medium-size MogileFS cluster, with about 160 million files and 50 TB of data, triple-replicated. We had great uptime until we ran out of I/O capacity on the metadata DB. Then we had a week of 10% downtime, while we ordered new database servers from Dell. As far as I remember, S3's US Standard region hasn't h…

> My current company spends a few hundred dollars a month on S3. I certainly couldn't match S3's uptime at that budget. Maybe I could do it at 2-3X the budget, but with that budget it might be easier to mirror my files across multiple S3 regions.

Exactly. Build multi-region support into your app(s), enable S3's replication so objects in your primary region are replicated to another region, and then properly handle loss of a region (go read-only or write to another region and restore consistency later).

You'll still be spending less than attempting to maintain a highly durable object store yourself across multiple datacenters or geographic areas.

Re: AWS S3 Having Problems Again? (Monday 12PM Pacific)

#38
post #31

The us-east-1 region gets treated differently than all other regions by AWS. Part of the reason it gets treated differently it is the default, and hence the most popular. It also doesn't help that it is on the east coast, and experiences more weather. For the above reasons, and that I work in the SF bay area, I put everything in us-west-2. us-west-2 sometimes has it's own issues, but nothing quite at the level of us-…

We're all just huddling in us-east-1 waiting for the day us-west-2 falls into the ocean...

Re: AWS S3 Having Problems Again? (Monday 12PM Pacific)

#39
post #36

We saw a short burst of 503s a short while ago, but we have not seen any since. Hopefully we do not see any more though. Also, for the record, S3 has been very stable for us otherwise. We have been rather happy with AWS overall.

Same, though just as I write this we see another spike of errors.
Post reply on HN