Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

281–290 of 630 posts

Re: Google Cloud Is Down

#281

Earlier quoted context omitted.

The small bare metal hosting company I use for some projects hardly goes down, and when there is an issue, I can actually get a human being on the phone in 2 minutes. Plus, a bare metal server with tons of RAM costs less than a small VM on the big cloud providers.

> a bare metal server with tons of RAM costs less than a small VM on the big cloud providers Who are you getting this steal of a deal from?

hetzner.de, online.net, ovh.com, netcup.de for the EU-market.

Re: Google Cloud Is Down

#284
post #197

Does anyone know if this is a regional or global outage? I can see my GKE clusters in one region but not in another, so I am guessing it's the former. Looks like we'll need a cluster in each region going forward...

To help others: which two regions?

us-central1 is up

us-east4 is down

Re: Google Cloud Is Down

#285
post #213
post #187

Earlier quoted context omitted.

I see a lot of Nest complaints, isn't there any security issue if Nest goes down?

I see people complain about Nest and the only thing I can think of is "what on earth where you thinking to have a door or thermostat that doesn't function without internet?!"

Nest thermostats can function without Internet. You can walk up to it and adjust the temperature just like any old thermostat.

Re: Google Cloud Is Down

#286
post #233

Prediction: the final postmortem will say "someone pushed a bad config", just like most of the previous postmortems (and most of the internal postmortems as well, for Borg-based services). This is the cause of most other outages in other cloud providers as well. A really hard to solve problem.

Multiple regions seem to be affected though. Wouldn't it make more sense to start out config pushes with a single region before expanding it to avoid these types of wide outages?

It's a networking outage. Google is a well known user of SDN. Networks, by virtue of connecting things, necessarily affect more than one region.

Re: Google Cloud Is Down

#287
post #63

Disclosure: I work on Google Cloud (but disclaimer, I'm on vacation and so not much use to you!). We're having what appears to be a serious networking outage. It's disrupting everything, including unfortunately the tooling we usually use to communicate across the company about outages. There are backup plans, of course, but I wanted to at least come here to say: you're not crazy, nothing is lost (to those concerns do…

Seems to be the private network. The public network looks fine to us from all over the world?

Re: Google Cloud Is Down

#289

Nice overview : https://downdetector.com/

Instagram is on GCloud? Facebook has a heavy investment in their own DCs, I thought they would have transitioned to them by now.

Just because you run your own ram and compute doesn’t mean you run your object store, too. Running drives is a commodity now, and crypto is cheap since aes-ni.

No idea if this is what instagram does or not, just in general. Drives are hot and need lots of power and it’s expensive to out-S3 S3.

Post reply on HN