Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Cloud Europe service disruption

status.cloud.google.com

Post reply on HN
Print view View original

41–50 of 153 posts

Re: Google Cloud Europe service disruption

#41

Post by londons_explore »

rippercushions wrote: post #12

Title is incorrect, this is not a general outage. There are two separate issues: europe-west-9 (Paris) has been physically flooded with water somehow and is hard down. This is obviously bad if you're using the region in question, but has zero impact elsewhere. https://status.cloud.google.com/incidents/dS9ps52MUnxQfyDGPf... There is a separate issue stopping changes to HTTP load balancers across most of GCP, but it ha…

> There is a separate issue stopping changes to HTTP load balancers across most of GCP

Is it me, or has Google had issues with pushing changes to load balancers pretty much every few months for the past decade? Even before GCP launched, people here on HN sometimes said an outage was extended because load balancer configs couldn't be changed.

Have they not considered just redesigning their config push mechanism...

Re: Google Cloud Europe service disruption

#42

Post by hf_twink »

numbsafari wrote: post #39
nielsole wrote: post #35

> Water intrusion in europe-west9-a > We expect general unavailability of the europe-west9 region. Why would emergency shutdown of a single AZ lead to general unavailability of a region? Isn't that the point of multiple AZs? > There is no current ETA for recovery of operations in the europe-west9 region at this time, but it is expected to be an extended outage yikes

From other comments here, it sounds like multiple zones in that region are located in the same datacenter? If so, that's ... not good.

that’s how GCP does zones, firewalled off with separate networks/power in the same physical location.

Re: Google Cloud Europe service disruption

#43

Post by bilekas »

wut42 wrote: post #16
belter wrote: post #7

Earlier quoted context omitted.

How large is the flood? How far away are these zones?

It happened at GlobalSwitch Clichy, near Paris. From what I gathered from a french forum[1], it started with a flood and then a fire. No rooms have been affected, apparently. [1]: https://lafibre.info/datacenter/incendie-maitrise-globalswit...

I'm getting horrible flashbacks of OVH DC's those many years ago.

Re: Google Cloud Europe service disruption

#44

Post by brookst »

iainmerrick wrote: post #20
cal85 wrote: post #17

Earlier quoted context omitted.

I thought it meant “now available” and was surprised it wasn’t already.

Yes, it would be less confusing to say “down”.

Or just "released, down, and canceled" to tighten up the news cycle.

Re: Google Cloud Europe service disruption

#45

Post by martius »

bsdz wrote: post #19
rippercushions wrote: post #12

Title is incorrect, this is not a general outage. There are two separate issues: europe-west-9 (Paris) has been physically flooded with water somehow and is hard down. This is obviously bad if you're using the region in question, but has zero impact elsewhere. https://status.cloud.google.com/incidents/dS9ps52MUnxQfyDGPf... There is a separate issue stopping changes to HTTP load balancers across most of GCP, but it ha…

I'm not sure if it's a separate issue but I've had trouble creating new VM instances in Google Cloud Console or listing GPU types using their CLI and I'm in europe-west-2. The ticket I was following originally got merged with the Paris flood ticket (by Google). It was working until midnight (London) last night but went down before 8am before recovering about 1h ago for me. Not sure why an outage at one regional data…

Cloud Console is having issues related to the outage in europe-west9

> Customer using Cloud Console globally are unable to open and view the Compute Engine related pages like: Instance creation page Disk creation page Instance templates page Instance Groups page

https://status.cloud.google.com/incidents/dS9ps52MUnxQfyDGPf...

Re: Google Cloud Europe service disruption

#46

Post by mschuster91 »

hf_twink wrote: post #42
numbsafari wrote: post #39

Earlier quoted context omitted.

From other comments here, it sounds like multiple zones in that region are located in the same datacenter? If so, that's ... not good.

that’s how GCP does zones, firewalled off with separate networks/power in the same physical location.

Ouch. Isn't part of separate zones being protected against something, say, like a terrorist attack or a natural disaster that can take down a whole datacenter?

Re: Google Cloud Europe service disruption

#47

Post by anonymousDan »

mschuster91 wrote: post #46
hf_twink wrote: post #42

Earlier quoted context omitted.

that’s how GCP does zones, firewalled off with separate networks/power in the same physical location.

Ouch. Isn't part of separate zones being protected against something, say, like a terrorist attack or a natural disaster that can take down a whole datacenter?

AFAIK if you dig into the details, the different cloud providers have very different concepts of what constitutes an AZ with respect to the types of faults that are isolated.

Re: Google Cloud Europe service disruption

#50

Post by Jamie9912 »

bilekas wrote: post #43
wut42 wrote: post #16

Earlier quoted context omitted.

It happened at GlobalSwitch Clichy, near Paris. From what I gathered from a french forum[1], it started with a flood and then a fire. No rooms have been affected, apparently. [1]: https://lafibre.info/datacenter/incendie-maitrise-globalswit...

I'm getting horrible flashbacks of OVH DC's those many years ago.

THAT was many years ago? Felt like yesterday
Post reply on HN