Shameless plug for https://rollbar.com
Good luck out there!
GCP Outage
261–270 of 539 posts
Re: GCP Outage
#262It's completely nuts that Firebase has this: https://status.firebase.google.com/incidents/ZcF1YDUvpdixZ2e... "Firebase Data Connect unavailable due to a known Google Cloud global outage" While the Google Cloud status page https://status.cloud.google.com/ says "No major incidents" and everything is green. So Google Cloud know there is an outage but just deem it not major enough to show it. Edit to add: within 10 minut…
IIRC status pages drive customer compensation for downtime. Updating it is basically signing the check for their biggest customers, in most similar companies you need a very senior executive to approve the update
On the other side of this, Firebase probably doesn't have money at stake making the update
Re: GCP Outage
#263Re: GCP Outage
#264Earlier quoted context omitted.
I'm actually on a bridge call with Google Cloud, we're a large customer -- I just learned today that their status page is not automated, instead someone actually manually updates it!
That's the case with every status page. These pages are managed by business people not engineers, because their primary purpose is to show customers that the company is meeting contractually defied SLAs.
Surelly no SLA will be based on the display of the status page...
Re: GCP Outage
#265Everything appears to be down as of 18:43 UTC... https://downdetector.com/
Well that's interesting. I wouldn't expect AWS or Microsoft 365 to be affected by a Google outage.
Re: GCP Outage
#266Where are the AI agents?
Poor agents, finally taking a break
Re: GCP Outage
#267if everything down at the same time - No one is mentioning an attack on us cloud services ? ( China or Russia ) Maybe ?
Re: GCP Outage
#268It's completely nuts that Firebase has this: https://status.firebase.google.com/incidents/ZcF1YDUvpdixZ2e... "Firebase Data Connect unavailable due to a known Google Cloud global outage" While the Google Cloud status page https://status.cloud.google.com/ says "No major incidents" and everything is green. So Google Cloud know there is an outage but just deem it not major enough to show it. Edit to add: within 10 minut…
IIRC status pages drive customer compensation for downtime. Updating it is basically signing the check for their biggest customers, in most similar companies you need a very senior executive to approve the update On the other side of this, Firebase probably doesn't have money at stake making the update
It is not the status page that drives customer compensation. It is downtime.
Re: GCP Outage
#269They've now added this as a major incident - before it just was listed under overview
Re: GCP Outage
#270Earlier quoted context omitted.
Doesn't cloudflare have its own infrastructure, it's wild to me that both these things are down presumably together with this size of a blast radius.
You'd think so wouldn't you? DownDetector also reports azure and oracle cloud, I can't see then also being dependant on GCP... I guess down detector isn't a full source of truth though. https://ocistatus.oraclecloud.com/#/ https://azure.status.microsoft/en-gb/status Both green
Using Azure here, no issues reported so far.