Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

161–170 of 630 posts

Re: Google Cloud Is Down

#161
post #134

Earlier quoted context omitted.

> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png

This is a person who's trying to help out while on vacation...can we try being more thankful, and not nitpick everything they say?

Thanks! I’ll leave this here as evidence that I should rightfully reduce my days off by 1 :).

Re: Google Cloud Is Down

#165
post #80

Earlier quoted context omitted.

Edit: and I agree! I’m not in SRE so I don’t bother with all the backup modes (direct IRC channel, phone lines, “pagers” with backup numbers). I don’t think the networking SRE folks are as impacted in their direct communication, but they are (obviously) not able to get the word out as easily. Still, it seems reasonable to me to use tooling for most outages that relies on “the network is fine overall”, to optimize for…

> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png

While not exactly google cloud, G suite dashboard seems accurate: https://www.google.com/appsstatus#hl=en&v=status

Re: Google Cloud Is Down

#166
post #67
post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

> including unfortunately the tooling we usually use to communicate across the company about outages. There's some irony in that.

AWS experienced a major outage a few years ago that couldn't be communicated to customers because it took out all the components central to update the status board. One of those obvious-in-hindsight situations.

Not long after that incident, they migrated it to something that couldn't be affected by any outage. I imagine Google will probably do the same thing after this :)

Re: Google Cloud Is Down

#167
post #151

Earlier quoted context omitted.

To clarify something: this outage doesn’t appear to be global, but it is hitting us particularly hard in parts of the US. So for the folks with working VMs in Mumbai, you’re not crazy. But for everyone with sadness in us-central1, the team is on it.

It seems global to me. This is really strange compared to AWS. I don't remember an outage there (other than s3) impacting instances or networking globally.

You obviously don't recall the early years of AWS. Half of internet would go down for hours.

Re: Google Cloud Is Down

#168
post #82

Earlier quoted context omitted.

>nothing is lost except time

Can't use my Nest lock to let guests into my house. I'm pretty sure their infrastructure is hosted in Google Cloud. So yeah... definitely some stuff lost.

To bad we don't have google cars yet.

Re: Google Cloud Is Down

#170
post #127

Earlier quoted context omitted.

How come?

Solutions based on third-party butts have essentially two modes: the usual, where everything is smooth, and the bad one, where nothing works and you're shit out of luck - you can't get to your data anymore, because it's in my butt, accessible only through that butt, and arguably not even your data. With on-prem solutions, you can at least access the physical servers and get your data out to carry on with your day whi…

Took me a second.

I didn’t know the cloud-to-butt translator worked on comments too. I forgot that was even a thing.

Post reply on HN