AWS S3 Outage • Hacker News Board

Re: AWS S3 Outage

#41

Post by mnutt » Mon, Aug 10, 2015, 8:29 AM UTC

jakozaur wrote: post #37

Open-source library request: A library that lets you use S3 and Google Storage Cloud simultaneously and fail-back to another if one have problems. There are many use-case when paying 2x for storage is a reasonable tradeoff for higher availability and also be provider independent.

Depending on your use case, it may be slightly easier to accomplish this with s3 event notifications + AWS Lambda to write to a different region or service.

Importantly, make sure you CNAME your bucket under your own domain so that you can switch services.

edit: Much easier than AWS Lambda, actually: http://aws.amazon.com/about-aws/whats-new/2015/03/amazon-s3-...

Re: AWS S3 Outage

#42

Post by greenleafjacob » Mon, Aug 10, 2015, 8:31 AM UTC

We are seeing lots of 503s, empty response bodies, and peer reset / dropped connections.

Re: AWS S3 Outage

#43

Post by jakozaur » Mon, Aug 10, 2015, 8:32 AM UTC

ketralnis wrote: post #40

jakozaur wrote: post #37

Open-source library request: A library that lets you use S3 and Google Storage Cloud simultaneously and fail-back to another if one have problems. There are many use-case when paying 2x for storage is a reasonable tradeoff for higher availability and also be provider independent.

What's stopping you from writing it?

Time and priorities. There is a difference between "I wish this thing existed, so I can use it/contribute to it" and "I need it so badly that I'm willing to spend a lot of time to make it production ready".

So far S3 seems to be reliable enough...

Re: AWS S3 Outage

#44

Post by chncdcksn » Mon, Aug 10, 2015, 8:32 AM UTC

GitHub is having release download issues, possibly due to this. https://status.github.com/

Re: AWS S3 Outage

#45

Post by [deleted] » Mon, Aug 10, 2015, 8:36 AM UTC

[deleted]

Re: AWS S3 Outage

#46

Post by nmjohn » Mon, Aug 10, 2015, 8:36 AM UTC

gschier wrote: post #19

fizx wrote: post #16

I wonder what it would take for amazon to show one of the yellow icons on their status page? Has it ever happened? Would a datacenter have to fall in the ocean?

Ya, it bothers me that their status messages for major outages are simply "elevated error rates".

Whats frustrating is when you have customers who are also down because of the outage - but when you say Amazon is experiencing severe outages causing 50% of our requests to be dropped and there's not much we can do, it makes us look pretty bad when they they go to the amazon dashboard and only see "Elevated Error Rates."

Re: AWS S3 Outage

#47

Post by dhruvbhatia » Mon, Aug 10, 2015, 8:38 AM UTC

adamtulinius wrote: post #6

Can't pull docker images from the hub either, and their statuspage currently shows S3-problems: https://status.docker.com/

Can't docker login or pull images from the hub. Both operations hang.

Re: AWS S3 Outage

#48

Post by jontro » Mon, Aug 10, 2015, 8:40 AM UTC

Looks like this brought down typekit too. "Font Network is experiencing issues caused by an outage at our storage provider." http://status.typekit.com/

Re: AWS S3 Outage

#49

Post by Maxious » Mon, Aug 10, 2015, 8:41 AM UTC

chncdcksn wrote: post #44

GitHub is having release download issues, possibly due to this. https://status.github.com/

Mapbox and Hipchat too https://www.mapbox.com/status/ https://status.hipchat.com/

Re: AWS S3 Outage

#50

Post by seany » Mon, Aug 10, 2015, 8:45 AM UTC

fizx wrote: post #16

I wonder what it would take for amazon to show one of the yellow icons on their status page? Has it ever happened? Would a datacenter have to fall in the ocean?

It did finally change just now.