Google Cloud Is Down • Hacker News Board

Re: Google Cloud Is Down

#151

Post by boulos » Sun, Jun 02, 2019, 8:37 PM UTC

boulos wrote: post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

To clarify something: this outage doesn’t appear to be global, but it is hitting us particularly hard in parts of the US. So for the folks with working VMs in Mumbai, you’re not crazy. But for everyone with sadness in us-central1, the team is on it.

Re: Google Cloud Is Down

#152

Post by mindcrime » Sun, Jun 02, 2019, 8:37 PM UTC

jamisonbryant wrote: post #104

I've noticed problems on GDrive (GSuite) and YouTube as well. Connected?

FWIW, Youtube is fine for me, but I'm seeing intermittent errors saving updates to a document in GSuite. I had thought the latter error was a problem with the wifi where I am, until I saw this. Now I'm not so sure. HN is loading fine on the same wifi...

Re: Google Cloud Is Down

#153

Post by stanfordkid » Sun, Jun 02, 2019, 8:37 PM UTC

SmokeGS wrote: post #82

boulos wrote: post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

>nothing is lost except time

Can't use my Nest lock to let guests into my house. I'm pretty sure their infrastructure is hosted in Google Cloud. So yeah... definitely some stuff lost.

Re: Google Cloud Is Down

#154

Post by [deleted] » Sun, Jun 02, 2019, 8:38 PM UTC

pm90 wrote: post #134

marksomnian wrote: post #87

Earlier quoted context omitted.

> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png

This is a person who's trying to help out while on vacation...can we try being more thankful, and not nitpick everything they say?

[deleted]

Re: Google Cloud Is Down

#155

Post by hinkley » Sun, Jun 02, 2019, 8:38 PM UTC

toomuchtodo wrote: post #101

sdan wrote: post #89

Earlier quoted context omitted.

and a nice Sunday afternoon

And the illusion of superiority over non cloud offerings.

I keep trying to explain to people that our customers don’t care that there is someone to blame they just want their shit to work. There are advantages to having autonomy when things break.

There’s a fine line or at least some subtlety here though. This leads to some interesting conversations when people notice how hard I push back against NIH. You don’t have to be the author to understand and be able to fiddle with tool internals. In a pinch you can tinker with things you run yourself.

Re: Google Cloud Is Down

#156

Post by MrMorden » Sun, Jun 02, 2019, 8:38 PM UTC

hazeii wrote: post #86

colinbartlett wrote: post #31

Google Cloud is the number 4 most monitored status page on StatusGator and Google Apps is number 12. In addition, at least 20 other services we monitor seemingly depend on Google Cloud because they all posted issues as soon as Google went down. It's always interesting to see these outages at large cloud providers spider out across the rest of the internet, a lot of the world depends on Google to stay up.

...and only the paranoid survive?

Just because you're paranoid, it doesn't mean they're not out to get you.

Re: Google Cloud Is Down

#157

Post by agentile » Sun, Jun 02, 2019, 8:38 PM UTC

hazeii wrote: post #117

squarefoot wrote: post #53

And Gmail too doesn't feel very well today. [21:55:19] POP PASS ******** [21:55:21] POP STAT [21:55:21] POP

IMAP as well - for some considerable time now.

Yes experiencing IMAP auth/connectivity issues here as well, along with outgoing SMTP

Re: Google Cloud Is Down

#158

Post by briandear » Sun, Jun 02, 2019, 8:39 PM UTC

avocado4 wrote: post #112

markoa wrote: post #92

We're hosting an open global Zoom call for all engineers affected by the outage, join us at https://zoom.us/j/793450725

One click on this link and it instantly starts streaming your webcam footage to everyone in the chat room.

Put some clothes on.

Re: Google Cloud Is Down

#159

Post by javabean_ » Sun, Jun 02, 2019, 8:39 PM UTC

Nice overview : https://downdetector.com/

Re: Google Cloud Is Down

#160

Post by digaozao » Sun, Jun 02, 2019, 8:39 PM UTC

boulos wrote: post #151

boulos wrote: post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

To clarify something: this outage doesn’t appear to be global, but it is hitting us particularly hard in parts of the US. So for the folks with working VMs in Mumbai, you’re not crazy. But for everyone with sadness in us-central1, the team is on it.

It seems global to me. This is really strange compared to AWS. I don't remember an outage there (other than s3) impacting instances or networking globally.