Google Cloud Is Down • Hacker News Board

Re: Google Cloud Is Down

#71

Post by sdan » Sun, Jun 02, 2019, 8:06 PM UTC

Github contribution graphs are also gone

Re: Google Cloud Is Down

#72

Post by sadris » Sun, Jun 02, 2019, 8:06 PM UTC

So is Youtube.

Re: Google Cloud Is Down

#73

Post by Havoc » Sun, Jun 02, 2019, 8:06 PM UTC

vpontis wrote: post #42

mandatory wrote: post #18

Yep, I can no longer see my Cloud SQL database - it's as if I've never created one at all. Really hoping this is just an issue displaying it and that Google hasn't punted my infrastructure and backups.

Praying isn't working. Now, I'll try sobbing :(

Systematic problem solving. I like it

Re: Google Cloud Is Down

#74

Post by [deleted] » Sun, Jun 02, 2019, 8:07 PM UTC

[deleted]

Re: Google Cloud Is Down

#75

Post by duality » Sun, Jun 02, 2019, 8:07 PM UTC

PerfectElement wrote: post #46

Just 2 weeks after I migrated a DB cluster from Azure to Google Cloud thinking things would get better.

FWIW they might still be.

Re: Google Cloud Is Down

#76

Post by mtarnovan » Sun, Jun 02, 2019, 8:08 PM UTC

Is shopify on google cloud? i noticed they are having issues too

Re: Google Cloud Is Down

#77

Post by ToniCipriani » Sun, Jun 02, 2019, 8:08 PM UTC

squarefoot wrote: post #53

And Gmail too doesn't feel very well today. [21:55:19] POP PASS ******** [21:55:21] POP STAT [21:55:21] POP

Pretty much Gsuite is out: https://www.google.com/appsstatus#hl=en&v=status

Re: Google Cloud Is Down

#78

Post by 40acres » Sun, Jun 02, 2019, 8:09 PM UTC

Can't wait for the postmortem!

Re: Google Cloud Is Down

#79

Post by andrewprock » Sun, Jun 02, 2019, 8:09 PM UTC

echelon wrote: post #51

Nest is down for me right now. It's amazing how far-reaching outages can be these days.

Code reuse is a wonderful thing, until it's not.

Re: Google Cloud Is Down

#80

Post by boulos » Sun, Jun 02, 2019, 8:10 PM UTC

odiroot wrote: post #67

boulos wrote: post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

> including unfortunately the tooling we usually use to communicate across the company about outages. There's some irony in that.

Edit: and I agree!

I’m not in SRE so I don’t bother with all the backup modes (direct IRC channel, phone lines, “pagers” with backup numbers). I don’t think the networking SRE folks are as impacted in their direct communication, but they are (obviously) not able to get the word out as easily.

Still, it seems reasonable to me to use tooling for most outages that relies on “the network is fine overall”, to optimize for the common case.

Note: the status dashboard now correctly highlights (Edit: with a banner at the top) that multiple things are impacted because Networking. The Networking outage is the root cause.