Earlier quoted context omitted.
> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png
This is a person who's trying to help out while on vacation...can we try being more thankful, and not nitpick everything they say?
Google Cloud Is Down
161–170 of 630 posts
Re: Google Cloud Is Down
#162GCP status page is worthless as it's always happy and green when production systems are down and then they might acknowledge something an hour later
Re: Google Cloud Is Down
#163Re: Google Cloud Is Down
#164Re: Google Cloud Is Down
#165Earlier quoted context omitted.
Edit: and I agree! I’m not in SRE so I don’t bother with all the backup modes (direct IRC channel, phone lines, “pagers” with backup numbers). I don’t think the networking SRE folks are as impacted in their direct communication, but they are (obviously) not able to get the word out as easily. Still, it seems reasonable to me to use tooling for most outages that relies on “the network is fine overall”, to optimize for…
> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png
Re: Google Cloud Is Down
#166Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…
> including unfortunately the tooling we usually use to communicate across the company about outages. There's some irony in that.
Not long after that incident, they migrated it to something that couldn't be affected by any outage. I imagine Google will probably do the same thing after this :)
Re: Google Cloud Is Down
#167Earlier quoted context omitted.
To clarify something: this outage doesn’t appear to be global, but it is hitting us particularly hard in parts of the US. So for the folks with working VMs in Mumbai, you’re not crazy. But for everyone with sadness in us-central1, the team is on it.
It seems global to me. This is really strange compared to AWS. I don't remember an outage there (other than s3) impacting instances or networking globally.
Re: Google Cloud Is Down
#168Re: Google Cloud Is Down
#169https://downdetector.com/ Pretty much every service is down
Re: Google Cloud Is Down
#170Earlier quoted context omitted.
How come?
Solutions based on third-party butts have essentially two modes: the usual, where everything is smooth, and the bad one, where nothing works and you're shit out of luck - you can't get to your data anymore, because it's in my butt, accessible only through that butt, and arguably not even your data. With on-prem solutions, you can at least access the physical servers and get your data out to carry on with your day whi…
I didn’t know the cloud-to-butt translator worked on comments too. I forgot that was even a thing.