Other submission linking to AWS status page: https://news.ycombinator.com/item?id=36315441
And what a surprise it's US-EAST-1 again...
AWS us-east-1 down
21–30 of 331 posts
Re: AWS us-east-1 down
#22I wonder if this is a coincidence or if us-east-1 is simply down enough that I'm just experiencing selection bias; but I posted a poll on twitter earlier today: https://twitter.com/dijit/status/1668678588713824257 Contents: > Has anyone ever actually had customers accept an outage because AWS was down; or is this just cloud evangelicalism copium? > [ ] Yeah, outages free pass > [ ] No, they say to use AZ's
> No, they say to use AZ's Using 3 AZs in us-east-1 won't save you. I guess a demanding customer would have said 'you should have implemented disaster recovery so you could failover to us-east-2' but that's easier said than done. The more regional AWS services you adopt, the bigger the impact is. How does one recover from a regional outage if their pipeline is in that region?
I’ve worked for several systemically important megacorps where certain things had to not only run cross region but also cross provider. It’s absurdly difficult, and only should be done if you need five or more 9’s of availability. Almost nothing actually does.
Re: AWS us-east-1 down
#23this happened less than an hour after I altered our prod scheme, thought I brought down production, what a relief
No, you brought down us-east-1 instead! Thanks!
Re: AWS us-east-1 down
#24It's always during the demos to the stakeholders, isn't it?
Re: AWS us-east-1 down
#25Tried to log on to OkCupid and it was down, I guess I should thank Jeff for taking me off the Skinner Box for a while.
Re: AWS us-east-1 down
#26us-east-1 seems to be very 'special' compared to the other regions - I wonder if they will ever align it with the rest of them.
Re: AWS us-east-1 down
#27The second law of thermodynamics guarantees that there will always / eventually be downtime… and that’s okay. Design for downtime. Shameless self-plug for https://heiioncall.com/ for free website / HTTP endpoint monitoring and cron job monitoring if you want to know about your own app’s downtime.
EDIT: thanks to those of you who have signed up in the past few minutes! Let us know if you have any feedback.
Re: AWS us-east-1 down
#28For those wondering: Currently PDT is 7 hours behind UTC.
AWS can do so many things, reporting critical outage updates in UTC is not one of those things.
Re: AWS us-east-1 down
#29We are seeing console, codebuild, etc. access issues. Possibly all using Lambdas, foundationally?
Re: AWS us-east-1 down
#30yep can't even get into console to diagnose / troubleshoot / fix
CLI works OK still.