I blame Pokémon Go. Somehow or another I'm sure it's to blame.
Global Outage?: http://downdetector.com/status/pokemon-go/map/
AWS increased error rates / intermittent outages
31–40 of 52 posts
Re: AWS increased error rates / intermittent outages
#32Just got through to the AWS Console. Finally can get back to work.
Re: AWS increased error rates / intermittent outages
#33Seems to be effecting everything but I have some running instances that seem fine. https://cloudstatus.eu/status/aws
Edit: Does seem to be recovering now
Re: AWS increased error rates / intermittent outages
#34Dammit now my Amazon Echo doesn't work.
I feel sad for a lonely grandma somewhere; her grandchildren never visit, but they bought her an Alexa to talk to that Amazon couldn't keep online.
Re: AWS increased error rates / intermittent outages
#35Earlier quoted context omitted.
Yeah I wrote this during the last extended outages - had some downtime since, well, I couldn't interact with the api :P . The source code for it is here: https://github.com/josegonzalez/real-aws-status
Well their status page is down too: https://status.aws.amazon.com/ Edit: http(s) was at fault (no SSL cert?)
Yes no HTTPS.
Re: AWS increased error rates / intermittent outages
#36Is anyone having issues with their lambda functions not working? Mine stopped working and is just returning "Service error." when I try to test even though they claim it's operating normally.
Re: AWS increased error rates / intermittent outages
#37AWS would wish that all those downtime reporting services move to their infrastructure. That ways there won't be anyone to report the downtime.
Re: AWS increased error rates / intermittent outages
#38Re: AWS increased error rates / intermittent outages
#39I like how half the internet can die when EC2 has problems.
Part of the problem is that a large number of site pull in services, re-targeting, AB-test, and weird Javascript in general. These things are pulled in without questioning or demanding an SLA or putting in an easy way of pulling them back out. Even if you don't use AWS yourself, you can be sure that some third party you rely on is deploying on EC2. Of cause they'll never tell you that.
For most new stuff, we require that it can be loaded with something like Google Tag Manager or UberTag, so we can quickly disable them when they fail.
It doesn't help that Amazons status page isn't all that good and sometimes doesn't seem to actually reflect the true state of their service.
Re: AWS increased error rates / intermittent outages
#40Sorry guys, I knew I shouldn't have started my 4 instances at once.
It wasn't you. Somebody had set up auto-scaling at the behest of AWS support.