Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GCP Outage

status.cloud.google.com

Post reply on HN
Print view View original

121–130 of 539 posts

Re: GCP Outage

#124

Post by 9rx »

ashu1461 wrote: post #94
9rx wrote: post #43

Earlier quoted context omitted.

The program that updates the status page is hosted on Google Cloud.

So even then, it should have been able to correctly report the status, it somehow shows that the status page is not automated and any change there needs to go through someone manual.

A program that updates the status page failing does not imply that the status page is manually edited. It is not like you would generate a status page on every request.

Re: GCP Outage

#126

Post by hambro »

toomuchtodo wrote: post #85
hambro wrote: post #11

@dang could you merge this and https://news.ycombinator.com/item?id=44260669 ?

No notifications for mentions, have to email the mods at the hn@ email address.

I think I was a bit optimistic in the response time from mods. This thread won the popularity contest quite well...

Thanks for letting me know about emailing the mods, refreshingly explicit to send email.

Re: GCP Outage

#127

Post by hnuser123456 »

oxymoron wrote: post #67
ransom1538 wrote: post #21

Earlier quoted context omitted.

Why can't companies be honest with being down. It helps us all out so we don't spend an hour internalizing. We are truly in gods hands. $ prod Fetching cluster endpoint and auth data. ERROR: (gcloud.container.clusters.get-credentials) ResponseError: code=503, message=Visibility check was unavailable. Please retry the request and contact support if the problem persists

Because a lot of the time, not everyone is impacted, as the systems are designed to contain the "blast radius" of failures using techniques such as cellular architecture and [shuffle sharding]( https://aws.amazon.com/builders-library/workload-isolation-u... ). So sometimes a service is completely down for some customers and fully unaffected for other customers.

"there is a 5% chance your instance is down" is still a partial outage. A green check should only mean everything (about that service) is working for everyone (in that region) as intended.

Downdetector reports started spiking over an hour ago but there still isn't a single status that isn't a green checkmark on the status page.

Re: GCP Outage

#128

Post by ashu1461 »

sujayakar wrote: post #107
atonse wrote: post #26

Getting a lot of errors for Claude Sonnet 4 (Cursor) and Gemini Pro. Nooooo I'm going to have to use my brain again and write 100% of my code like a caveman from December 2024.

switch to auto mode and it should still work!

GPT is working in agent mode, which kind of confirms that claude is hosted on google and GPT probably on MSFT servers / self hosted.
Post reply on HN