This appears to be continuing to cascade over an hour later... wow... more and more services mentioned as completely down on the outage page.
Kind of nice to not be glued to AI chat prompts for a while to be honest.
GCP Outage
361–370 of 539 posts
Re: GCP Outage
#362Re: GCP Outage
#363Guess they used Jules to code their services :)
Re: GCP Outage
#3642 hour outage at this point
Re: GCP Outage
#365Earlier quoted context omitted.
That's the case with every status page. These pages are managed by business people not engineers, because their primary purpose is to show customers that the company is meeting contractually defied SLAs.
Surelly no SLA will be based on the display of the status page...
They aren't automatically based on that page, but seeing a red status makes it too easy for customers to point to it and go "see you were down, give us a refund".
Re: GCP Outage
#366Even though BigQuery is not listed in affected services, we see errors connecting to it
It's listed by regions :(
Re: GCP Outage
#367Re: GCP Outage
#368Earlier quoted context omitted.
Because a lot of the time, not everyone is impacted, as the systems are designed to contain the "blast radius" of failures using techniques such as cellular architecture and [shuffle sharding]( https://aws.amazon.com/builders-library/workload-isolation-u... ). So sometimes a service is completely down for some customers and fully unaffected for other customers.
"there is a 5% chance your instance is down" is still a partial outage. A green check should only mean everything (about that service) is working for everyone (in that region) as intended. Downdetector reports started spiking over an hour ago but there still isn't a single status that isn't a green checkmark on the status page.
Just say it: they want to lie to 95% of customers.
Re: GCP Outage
#369The status page is green, but there are outages reported: https://downdetector.com/status/google-cloud/
Why even have a status page? Someone reported that their org of >100,000 users can't use Google Meet. If corps aren't going to update their status page, might as well just not have one. https://www.google.com/appsstatus/dashboard/ https://status.cloud.google.com/index.html Edit: The GCP status page got updated <1 minute after I posted this, showing affected services are Cloud Data Fusion, Cloud Memorystore, Cloud She…
I have zero faith in status pages. It's easier and more reliable to just check twitter.
Heroku was down for _hours_ the other day before there was any mention of an incident - meanwhile there were hundreds of comments across twitter, hn, reddit etc.
Re: GCP Outage
#370Earlier quoted context omitted.
Isn't RCS basically just instant messaging? I don't know why it's surprising that it would be down.
I'm not sure any single company could have an outage that would take out SMS globally, but RCS is presumably more centralized.
It used to be kind of distributed, but Google has been strong arming carriers to use their hosted Jibe service through a combination of proprietary extensions (e.g., E2E which is finally standard) and bypassing carrier control (if the carrier didn't provision RCS, Google Messages would use their own service iMessage-style).
From the end user's perspective, if the carrier didn't use Jibe RCS, it simply wouldn't work well.