Google Cloud Is Down • Hacker News Board

Re: Google Cloud Is Down

#131

Post by jjeaff » Sun, Jun 02, 2019, 8:28 PM UTC

kenhwang wrote: post #105

klon wrote: post #27

Anyone using both AWS and GCP that can form an opinion on availability of both? As a GCP customer I am not very happy with theirs.

AWS has what feel like monthly AZ brownouts (typically degradated performance or other control plane issues) with the yearly-ish regional brown/blackout. GCP has quarterly-ish global blackouts, and generally on the data plane at that which makes them significantly more severe.

Are there any services that track uptime for various regions and zones from various providers? It's rare that everything goes down and thus the cloud providers pretend they have almost no downtime.

Re: Google Cloud Is Down

#132

Post by sdan » Sun, Jun 02, 2019, 8:29 PM UTC

sorenn111 wrote: post #100

sdan wrote: post #95

Weird for Twitter to still be up and fully functioning. I thought they migrated everything to GCP this/last year?

Not the main functionality of the service, just lots of data analysis tooling. nothing that end users would notice

Interesting. Thought I had read some posts of them migrating their data, but you could definitely be right.

Re: Google Cloud Is Down

#133

Post by pishpash » Sun, Jun 02, 2019, 8:29 PM UTC

Let's see if perfect leetcode skills will save the day. /s

Re: Google Cloud Is Down

#134

Post by pm90 » Sun, Jun 02, 2019, 8:29 PM UTC

marksomnian wrote: post #87

boulos wrote: post #80

Earlier quoted context omitted.

Edit: and I agree! I’m not in SRE so I don’t bother with all the backup modes (direct IRC channel, phone lines, “pagers” with backup numbers). I don’t think the networking SRE folks are as impacted in their direct communication, but they are (obviously) not able to get the word out as easily. Still, it seems reasonable to me to use tooling for most outages that relies on “the network is fine overall”, to optimize for…

> the status dashboard now correctly highlights that multiple things are impacted because Networking. this column of green checkmarks begs to differ: https://i.imgur.com/2TPD9e9.png

This is a person who's trying to help out while on vacation...can we try being more thankful, and not nitpick everything they say?

Re: Google Cloud Is Down

#135

Post by jjeaff » Sun, Jun 02, 2019, 8:29 PM UTC

pm90 wrote: post #30

klon wrote: post #27

Anyone using both AWS and GCP that can form an opinion on availability of both? As a GCP customer I am not very happy with theirs.

GCP is incredibly bad at communicating when there are problems with their systems. Just terrible. Its only when our apps start to break that we notice something is down, then look at the green dashboard which is even more infuriating.

Their dashboard does show red on GCE and networking right now, for what it's worth. https://status.cloud.google.com/

Re: Google Cloud Is Down

#136

Post by wichert » Sun, Jun 02, 2019, 8:30 PM UTC

pgoodjohn wrote: post #50

Everything looking normal on our GKE / CloudSQL stuff (eu-west1)

gcloud tells me:

WARNING: The following zones did not respond: us-west2, us-west2-a, southamerica-east1-c, us-west2-b, southamerica-east1, us-east4-b, us-east4, us-east4-a, northamerica-northeast1-c, northamerica-northeast1-b, us-west2-c, southamerica-east1-b, northamerica-northeast1, southamerica-east1-a, northamerica-northeast1-a, us-east4-c. List results may be incomplete.

Luckily for us eu-west1 seems to be working normally.

Re: Google Cloud Is Down

#137

Post by CSDude » Sun, Jun 02, 2019, 8:32 PM UTC

With Google Cloud incidents, most of the time whole regions fail, and with AWS generally only a region fails. Of course there would be exceptions, but Google Cloud does not make me feel safe as an outsider (and a user of multi-region AWS)

Re: Google Cloud Is Down

#138

Post by bbayer » Sun, Jun 02, 2019, 8:32 PM UTC

wenbin wrote: post #70

btw, Google Analytics realtime is down as well.

I wasn't aware that outage and had small heartattack when I saw huge drop of visitors. I think other metrics are also affected.

Re: Google Cloud Is Down

#139

Post by lionradio » Sun, Jun 02, 2019, 8:32 PM UTC

ksajadi wrote: post #20

GCP status page is worthless as it's always happy and green when production systems are down and then they might acknowledge something an hour later

I think this might be a static page they are hosting on Akamai?

Re: Google Cloud Is Down

#140

Post by toomuchtodo » Sun, Jun 02, 2019, 8:32 PM UTC

k__ wrote: post #127

toomuchtodo wrote: post #101

Earlier quoted context omitted.

And the illusion of superiority over non cloud offerings.

How come?

There are some whole argue that the resiliency of cloud providers beats on prem or self hosted, and yet they’re down just as much or more (GCP, Azure, and AWS all the same). Don’t take my word for it; search HN for “$provider is down” and observe the frequency of occurrences.

You want velocity for your dev team? You get that. You want better uptime? Your expectations are gonna have a bad time. No need for rapid dev or bursty workloads? You’re lighting money on fire.

Disclaimer: I get paid to move clients to or from the cloud, everyone’s money is green. Opinion above is my own.