Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS Cognito is having issues and health dashboards are still green

status.aws.amazon.com

Post reply on HN
Print view View original

51–60 of 369 posts

Re: AWS Cognito is having issues and health dashboards are still green

#51

Post by NikolaeVarius »

gtsop wrote: post #23
gt565k wrote: post #19

Earlier quoted context omitted.

wah wah wah, my boss is chewing my ear out cuz I can't explain to him that it's a vendor (AWS) outage host on-premise then, and deal with power outages, and infrastructure management, and failing hardware shit happens, drink a coffee and sit back for 30 mins

His point is not about aws inability to have 0 downtime. His point is some people apparently pay based on a guarantee for uptime that is not delivered. He is criticizing a company not providing the service it sells and our inability to hold them accountable

Why is criticizing on a random forum "holding them accountable". Its pretty simple to hold them accountable, ask your service rep for refund based on contract SLA. Anything else is just soapbox grandstanding for the purpose of internet karma points

Re: AWS Cognito is having issues and health dashboards are still green

#53

Post by opmac »

Twirrim wrote: post #47
opmac wrote: post #33

Earlier quoted context omitted.

It is kind of perplexing that AWS dogfoods its own status page. I remember during the massive S3 outage a few years ago that their status page remained green almost the entire time because the red/green/blue icons for the status was stored in... wait for it... S3. You'd think they would have learned from that.

They did. It came up in the post incident report, and senior leadership kicked off work to have it run on its own distinct infrastructure so that this wouldn't happen again. If you look at where the content on https://status.aws.amazon.com/ is actually hosted from you'll see things like the status icons are all hosted under the same domain, e.g. https://status.aws.amazon.com/images/status1.gif https://status.aws.amaz…

K so they avoided that problem, but something similar has obviously gone wrong again, considering that Kinesis had been partially or fully down for almost an hour before the status page got their first update.

And the fact remains that currently an outage of AWS's own infrastructure is impacting AWS's ability to status updates on its own status dashboard. It's just seems so... amateurish.

Re: AWS Cognito is having issues and health dashboards are still green

#54

Post by latch »

s_dev wrote: post #25

Can anyone explain why status pages are so difficult. Theres even statups like status.io dedicated to this one thing. It really does seem that anytime there is an outage more often than not the status page is showing all green traffic lights. Making it redundant as a tool to corroborate whats happening. How did AWS status page compare with status.io/aws?

Status pages, like SLAs, are sales tool - not engineering tools. At best, they are there to help decision makers go through their checklist. At worse, they exist to deceive.

Re: AWS Cognito is having issues and health dashboards are still green

#56

Post by ceejayoz »

rexreed wrote: post #27
gtsop wrote: post #23

Earlier quoted context omitted.

His point is not about aws inability to have 0 downtime. His point is some people apparently pay based on a guarantee for uptime that is not delivered. He is criticizing a company not providing the service it sells and our inability to hold them accountable

Exactly. Try telling your boss when you paid a premium for uptime available that you just wasted a whole lot of money because you aren't getting the uptime you paid for. If AWS can't actually guarantee uptime (maybe no one can), then they need to have in their terms an automatic credit on a per-minute basis for uptime that is not delivered but otherwise paid for in a "guarantee".

They do exactly that already.

https://aws.amazon.com/legal/service-level-agreements/

Re: AWS Cognito is having issues and health dashboards are still green

#57

Post by tootie »

unilynx wrote: post #22

There's a lot more going on over there... - 7 cloudfront distributions created today are still in "InProgress", a few already for more than one hour - The support case I created about it doesn't show up in my support portal. Direct link to it does work though

I think the issue is that Kinesis is a single point of failure for a ton of systems. When it goes down, loads of other system's workflows can't operate. AWS is famous for eating their own dog food and someone just poisoned it.

Re: AWS Cognito is having issues and health dashboards are still green

#58

Post by skavish »

unilynx wrote: post #36
skavish wrote: post #30

Mediaconvert just stopped processing our queues two hours ago, in all our accounts. Anybody else is having it? It's green on the status board.

completed a job in eu-west-1 10 minutes ago

yep, it seems only us-east-1 is affected

Re: AWS Cognito is having issues and health dashboards are still green

#59

Post by unilynx »

LennyWhiteJr wrote: post #48
mikece wrote: post #39

Is this only affecting us-east-1 or other regions as well?

Just us-east-1.

But some global services run through us-east-1 - eg Cloudfront is now broken too. So this is also affecting users who don't actually run anything in us-east-1 explicitly (or in the US at all)
Post reply on HN