AWS us-east-1 outage • Hacker News Board

Re: AWS us-east-1 outage

#41

Post by cr3ative » Tue, Dec 07, 2021, 3:56 PM UTC

qudat wrote: post #28

zegl wrote: post #13

I love that every time this happens, 100% of the services on https://status.aws.amazon.com are green.

Status pages are hard

When they have too much pride in an all-green dash, sure. Allowing any engineer to declare a problem when first detected? Not so hard, but it doesn't make you look good if you have an ultra-twitchy finger. They have the balance badly wrong at the moment though.

Re: AWS us-east-1 outage

#42

Post by queuebert » Tue, Dec 07, 2021, 3:56 PM UTC

zegl wrote: post #13

I love that every time this happens, 100% of the services on https://status.aws.amazon.com are green.

Are they lying, or just prioritizing their own services?

Re: AWS us-east-1 outage

#43

Post by rhines » Tue, Dec 07, 2021, 3:57 PM UTC

saggy4 wrote: post #12

It seems that only console is having the problem CLI works fine

CLI for EC2 works for me, but not ELB.

Re: AWS us-east-1 outage

#44

Post by willcipriano » Tue, Dec 07, 2021, 3:57 PM UTC

judge2020 wrote: post #34

zegl wrote: post #13

I love that every time this happens, 100% of the services on https://status.aws.amazon.com are green.

I don't see why they couldn't provide an error rate graph like Reddit[0] or simply make services yellow saying "increased error rate detected, investigating..." 0: https://www.redditstatus.com/#system-metrics

A executive has a OKR around uptime and a automated system prevents him or her from having control over the messaging. Therefore any effort to create one is squashed, leaving the people requesting it confused as to why and left without any explanation. Oldest story in the book.

Re: AWS us-east-1 outage

#45

Post by kp195_ » Tue, Dec 07, 2021, 3:57 PM UTC

The AWS console seems kind of broken for us in us-west-1 (Northern California), but it seems like the actual services are working

Re: AWS us-east-1 outage

#46

Post by misthop » Tue, Dec 07, 2021, 3:57 PM UTC

Getting 500 errors across the board on systems trying to hit s3

Re: AWS us-east-1 outage

#47

Post by notreallyserio » Tue, Dec 07, 2021, 3:58 PM UTC

zegl wrote: post #13

I love that every time this happens, 100% of the services on https://status.aws.amazon.com are green.

Makes you wonder if they have to manually update the page when outages occur. That'd be a pretty bad way to go, so I'd hope not. Maybe the code to automatically update the page is in us-east-1? :)

Re: AWS us-east-1 outage

#48

Post by artembugara » Tue, Dec 07, 2021, 3:58 PM UTC

I think there should be some third-party status checker alliance.

It's a joke. Each time AWS/Azure/GCP is down their status page says all is fine.

Re: AWS us-east-1 outage

#49

Post by synergy20 » Tue, Dec 07, 2021, 3:58 PM UTC

No wonder I could not read books from amazon all of a sudden, what about their cloud-based redundancy design?

Re: AWS us-east-1 outage

#50

Post by albatross13 » Tue, Dec 07, 2021, 3:58 PM UTC

murph-almighty wrote: post #39

albatross13 wrote: post #24

Earlier quoted context omitted.

Yeah, I tend to go off of https://downdetector.com/status/aws-amazon-web-services/

I always got the impression that downdetector worked by logging the number of times they get a hit for a particular service and using that as a heuristic to determine if something is down. If so, that's brilliant.

I think it's a bit simpler for AWS- there's a big red "I have a problem with AWS" button on that page. You click it, tell it what your problem is, and it logs a report. Unless that's what you were driving at and I missed it, it's early. Too early for AWS to be down :(

Some 3600 people have hit that button in the last ~15 minutes.