Live data from Hacker News

GCP Outage

status.cloud.google.com

311–320 of 539 posts

Re: GCP Outage

#311

What's crazy is that RCS messaging is down as a result of this outage. It shows how poorly the technology or infrastructure was designed.

Isn't RCS basically just instant messaging? I don't know why it's surprising that it would be down.

Re: GCP Outage

#312
post #285

Earlier quoted context omitted.

The status page is essentially an admission of guilt. It can require approval from the legal department and a high level official from the company to approve updating it and the verbiage used on the status page.

then it’s fucking useless. Let’s crowd source our own

You're in the crowdsourced version right now.

Re: GCP Outage

#314

The status page is green, but there are outages reported: https://downdetector.com/status/google-cloud/

[dead]

AWS is fine: https://health.aws.amazon.com/health/status

My guess is whatever system downdetector uses to "detect downtime" relies on either GCP or Cloudflare (also having issues at the moment: https://www.cloudflarestatus.com/)

Re: GCP Outage

#316
post #307

If Google Chat is down per https://www.google.com/appsstatus/dashboard/ , the ability for Google engineers to communicate among themselves impaired, despite SREs having IRC as a backup.

Google Chat wasn't down for me throughout the entire incident.

Re: GCP Outage

#318
Haha, I don't ordinarily spend a lot of time in the Google Cloud Console but just now I was debugging a squirrely OAuth issue with reCAPTCHA failing to refresh several days running. I'm getting this weird page error, and I think, "Is this an issue with my organization? [futz futz futz] Hey wait is GCP actually down?" And it turns out to be the top discussion on HN. XD

Re: GCP Outage

#319

Earlier quoted context omitted.

Doesn't cloudflare have its own infrastructure, it's wild to me that both these things are down presumably together with this size of a blast radius.

You'd think so wouldn't you? DownDetector also reports azure and oracle cloud, I can't see then also being dependant on GCP... I guess down detector isn't a full source of truth though. https://ocistatus.oraclecloud.com/#/ https://azure.status.microsoft/en-gb/status Both green

Down Detector can have a poor signal to noise ratio given from what I am assuming is users submitting "this is broken" for any particular app. Probably compounded by many hearing of a GCP issue, checking their own cloud service, and reporting the problem at the same time.
Post reply on HN