Live data from Hacker News

Google Cloud Is Down

news.ycombinator.com

241–250 of 630 posts

Re: Google Cloud Is Down

#242

Earlier quoted context omitted.

Took me a second. I didn’t know the cloud-to-butt translator worked on comments too. I forgot that was even a thing.

I keep forgetting that I have it on, my brain treats the two words as identical at this point. The translator has this property, which I also tend to forget about, that it will substitute words in your HN comment if you edit it. But yeah, it's still a thing, and the message behind it isn't any less current.

There is a cloud I've developed that is secure and isn't a butt :P

https://hackaday.io/project/12985-multisite-homeofficehacker...

I made IoT using cheap (arduino, nrf24l01+, sensors/actuators) for local device telemetry, MQTT, node-red, and Tor for connecting clouds of endpoints that aren't local.

Long story short, its an IoT that is secure, consisting of a cloud of devices only you own.

Oh yeah, and GPL3 to boot.

Re: Google Cloud Is Down

#243
post #27

Anyone using both AWS and GCP that can form an opinion on availability of both? As a GCP customer I am not very happy with theirs.

I use both services heavily at work. The networking in GCP is terrible. We experience minor service degradation multiple times a month due to networking issues in GCP (elevated latency, errors talking to the DB, etc). We've even had cases where there was packet corruption at the bare metal layer, so we ended up storing a bunch of garbage data in our caches / databases. Also, the networking is less understandable on GCP compared to AWS. For instance, the external HTTP load balancer uses BGP and magic, so you aren't control of which zones your LB is deployed to. Some zones don't have any LBs deployed, so there is a constant cross-zone latency hit when using some zones. It took us months to discover this after consistent denials from Google Cloud support that something was wrong with a specific zone our service was running in.

AWS, on the other hand, has given us very few problems. When we do have an issue with an AWS service, we're able to quickly get an engineer on the phone who, thus far, has been able to explain exactly what our issue is and how to fix it.

Re: Google Cloud Is Down

#244
post #233

Prediction: the final postmortem will say "someone pushed a bad config", just like most of the previous postmortems (and most of the internal postmortems as well, for Borg-based services). This is the cause of most other outages in other cloud providers as well. A really hard to solve problem.

Multiple regions seem to be affected though. Wouldn't it make more sense to start out config pushes with a single region before expanding it to avoid these types of wide outages?

Re: Google Cloud Is Down

#245
post #127

Earlier quoted context omitted.

How come?

The small bare metal hosting company I use for some projects hardly goes down, and when there is an issue, I can actually get a human being on the phone in 2 minutes. Plus, a bare metal server with tons of RAM costs less than a small VM on the big cloud providers.

> a bare metal server with tons of RAM costs less than a small VM on the big cloud providers

Who are you getting this steal of a deal from?

Re: Google Cloud Is Down

#247

Earlier quoted context omitted.

It seems global to me. This is really strange compared to AWS. I don't remember an outage there (other than s3) impacting instances or networking globally.

You obviously don't recall the early years of AWS. Half of internet would go down for hours.

Back when S3 failures would take town Reddit, parts of Twitter .. Netflix survived because they had additional availability zones. I can remember the bigger names started moving more stuff to their own data centers.

AWS tries to lock people in to specific services now which makes it really difficult to migrate. It also takes a while before you get to the tipping point where hosting your own is more financially viable .. and then if you trying migrating, you're stuck using so many of their services you can't even do cost comparisons.

Re: Google Cloud Is Down

#248

It seems crazy to me that Google Cloud can have this level of instability but I, on the other hand, can never remember google.com going down. Why are they operating one with a different networking infrastructure from the other?

AFAIK google.com is running independently on a different infrastructure, but some of other services are relying on GCP hence the problem affects them too.

Re: Google Cloud Is Down

#249

Earlier quoted context omitted.

> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png

While not exactly google cloud, G suite dashboard seems accurate: https://www.google.com/appsstatus#hl=en&v=status

For me, at least, that was showing as all green for at least 30 minutes.

Re: Google Cloud Is Down

#250
post #237
post #67

Earlier quoted context omitted.

> including unfortunately the tooling we usually use to communicate across the company about outages. There's some irony in that.

Even more irony: Google+ shown as working fine: https://i.imgur.com/52ACuiY.png

G+ is alive and well for G Suite subscribers, not the general users.
Post reply on HN