This post (in french) has some more details:
Google Cloud region currently down due to water intrusion
101–110 of 187 posts
Re: Google Cloud region currently down due to water intrusion
#102Google now has a "data lake" in Paris.
[deleted]
Re: Google Cloud region currently down due to water intrusion
#103Earlier quoted context omitted.
1) Pay for stuff 2) Not be able to use it 3) Company continues to pretend this doesn't happen on the regular
> Company continues to pretend this doesn't happen on the regular What do you want them to say? "Hey we have X breakdowns but please, pay!"
It's more that everyone advertises so many 9's of uptime, but in reality they don't count anything less than a total outage of an entire datacenter as actual downtime against that statistic.
Re: Google Cloud region currently down due to water intrusion
#104This seems to significantly under-report what's going on, see: https://www.theregister.com/2023/04/26/google_cloud_outage/ There is mention of a fire as well.
The outage has been going on for 40+ hours now...
I think this is sort of big.
Re: Google Cloud region currently down due to water intrusion
#105Earlier quoted context omitted.
> Company continues to pretend this doesn't happen on the regular What do you want them to say? "Hey we have X breakdowns but please, pay!"
Admit that it's not really serverless or cloud computing but someone else's computers . Or just cut down on nonsense in some way. If they can figure out how to make nonsense, they can figure out how to dial it back.
I don’t see how this is a good argument? Yes, it’s someone else’s computers. That they rent me by the month or the hour or the second through a programmatic interface. That’s exactly the product I want. And it’s not surprising that it has outages sometimes because at the end of the day, yeah, it’s still just a bunch of computers someone has put in a room somewhere.
Re: Google Cloud region currently down due to water intrusion
#106Not sure what kind of fire there was there, but once those automatic sprinkler systems get going, they are very difficult to stop. Someone in my freshman college dorm decided to use one as a clothes hanger hook and broke the thermometer in there. The sprinkler damaged the entire floor with water and the floor below had spotty rain as well. The fire department came and was mainly concerned about evacuating everyone ra…
Always worth tracking down the sprinkler shut off valve in your residence/place of work. If you’re in a high rise it‘ll be the big red wheel on the sprinkler main in the fire stairs. If it’s a spurious activation you can just shut it off yourself, you don’t need to ask anybody’s permission. The fire department is always going to prioritize safety of life, and after all it’s not their stuff getting soaked.
> The fire department is always going to prioritize safety of life, and after all it’s not their stuff getting soaked.
They won't hesitate to smash your stuff or break down your walls either.
Being in a fire is no joke. You've got to be crazy to think that your stuff is important. It's not.
Re: Google Cloud region currently down due to water intrusion
#107A perfect example of when "cloud just means someone else's computers". It's literally a leaky abstraction.
google cloud poised for precipitous fall
Re: Google Cloud region currently down due to water intrusion
#108Not sure what kind of fire there was there, but once those automatic sprinkler systems get going, they are very difficult to stop. Someone in my freshman college dorm decided to use one as a clothes hanger hook and broke the thermometer in there. The sprinkler damaged the entire floor with water and the floor below had spotty rain as well. The fire department came and was mainly concerned about evacuating everyone ra…
Always worth tracking down the sprinkler shut off valve in your residence/place of work. If you’re in a high rise it‘ll be the big red wheel on the sprinkler main in the fire stairs. If it’s a spurious activation you can just shut it off yourself, you don’t need to ask anybody’s permission. The fire department is always going to prioritize safety of life, and after all it’s not their stuff getting soaked.
True, and if you mess up how are they gonna know?
Your fingerprints won’t survive the fire!
Re: Google Cloud region currently down due to water intrusion
#109Earlier quoted context omitted.
I don't know what it is like these days but us-east AZs used to be in different datacenters that were on different flood plains and power companies. They were just on a very high capacity (for the day) fiber ring. You still had a couple miles of light-delay latency in between them. A sufficiently big enough meteor, or a powerful enough massive hurricane, could probably take out multiple ones at the same time.
I believe the Google design is one big pool of machines, perhaps spread across a few buildings, but they hope that any failure only affects a few racks. They will arrange/move workloads such that any one customer will only see an outage in one 'zone'. Clearly that didn't work here,
That's .... that's not a great strategy. I get that it's cheap, but incidents like this will cost a LOT more with lost business.
Re: Google Cloud region currently down due to water intrusion
#110Earlier quoted context omitted.
Admit that it's not really serverless or cloud computing but someone else's computers . Or just cut down on nonsense in some way. If they can figure out how to make nonsense, they can figure out how to dial it back.
I don’t see how this is a good argument? Yes, it’s someone else’s computers. That they rent me by the month or the hour or the second through a programmatic interface. That’s exactly the product I want. And it’s not surprising that it has outages sometimes because at the end of the day, yeah, it’s still just a bunch of computers someone has put in a room somewhere.
Yeah this is the usual backlash of experts vs marketing vs management.
Someone else managing your shit so you don't have to is a market in just about every industry, and it makes a ton of sense in tech where things don't even have to be on the same continent to work (or very specifically NEED to be on another one if you're international).
There's a ton of companies that have jumped to the cloud that probably shouldn't have, and even more who should've jumped, but not nearly as much as they did. Still it's a useful service.
Now of course it being a useful service, that also happens to be so obscenely expensive to start up barely anyone does it, means it comes with all the miserable obfuscation, bullshit fine print, total lack of support, and every other horrible thing we've come to expect from the modern world, but "It's just someone else's computer!" isn't changing any minds.
Either they already knew that or they never cared.