Live data from Hacker News

OVH CEO Octave Klaba speaking about the incident [video]

ovh.com

111–120 of 143 posts

Re: OVH CEO Octave Klaba speaking about the incident [video]

#111
post #103

Earlier quoted context omitted.

Portable fire extinguishers: - 16 USD (when buying in bulk 200+) [0] - 236 USD ("Marine") [1] 12 Party balloons: - 3 USD [2] [0] https://mengfan.en.made-in-china.com/product/ksNEATWYXcVB/Ch... [1] https://pacificfireandmarine.com/products/sea-fire-model-c-f... [2] https://de.aliexpress.com/item/4000602253794.html

Oxygen suppresion doesn't damage the equipment. Good luck cleaning out your equipment after you spray fire extinguisher all over them.

All the fire extinguishers GP linked use either FM200 or equivalent clean agents. They're not "conventional" fire extinguishers. :)

Re: OVH CEO Octave Klaba speaking about the incident [video]

#112

Earlier quoted context omitted.

Oxygen suppresion doesn't damage the equipment. Good luck cleaning out your equipment after you spray fire extinguisher all over them.

All the fire extinguishers GP linked use either FM200 or equivalent clean agents. They're not "conventional" fire extinguishers. :)

I see, thanks for the education.

Re: OVH CEO Octave Klaba speaking about the incident [video]

#113
post #50

Earlier quoted context omitted.

The problem with water in the same place with high power equipment is that it instantly turns the room into a death trap for any personnel, now everything is potentially live. Also, in the first part of a lithium battery fire, dropping water on them is quite explosive. It will eventually quench the fire but on the short run it will make it worse, filling the room with explosive hydrogen and poisonous lithium hydroxid…

> The problem with water in the same place with high power equipment […] Most high-end UPSes have a relay where you can run an active-high or active-low emergency power off (EPO) signal. The EPO can either be a button that is pressed manually by the staff, automatically via fire suppression system, or both/either. Schneider-APC white paper (PDF) * https://download.schneider-electric.com/files?p_File_Name=AS... The EP…

Such a switch doesn't make any remaining battery charge in the UPS go away magically. If the UPS housing gets breached (e.g. ingress of impure water or bending/melting from heat), you're back to square one.

Re: OVH CEO Octave Klaba speaking about the incident [video]

#114

Earlier quoted context omitted.

> "it's only a matter of time until Lithium chemistry batteries are available and that also increases the risk of fire." Not all Li-ion chemistries are equal. In particular, the increasingly popular LiFePO4 (LFP) technology has much higher energy density, longer lifespan, improved environmental characteristics, and similar if not better safety characteristics compared to lead-acid. (Besides sharing lead-acid's very l…

> lead-acid's very low risk of fire Isn't lead-acid prone to releasing hydrogen gas? When jump-starting a car, it is commonly recommended to connect the ground (black) cable to the chassis, not to the battery's black terminal, to avoid a spark igniting the hydrogen and causing an explosion.

The lead-acid batteries used in data centres are normally "sealed lead-acid batteries" and release significantly less hydrogen.

See: https://en.wikipedia.org/wiki/VRLA_battery

Re: OVH CEO Octave Klaba speaking about the incident [video]

#115

Earlier quoted context omitted.

> "it's only a matter of time until Lithium chemistry batteries are available and that also increases the risk of fire." Not all Li-ion chemistries are equal. In particular, the increasingly popular LiFePO4 (LFP) technology has much higher energy density, longer lifespan, improved environmental characteristics, and similar if not better safety characteristics compared to lead-acid. (Besides sharing lead-acid's very l…

> lead-acid's very low risk of fire Isn't lead-acid prone to releasing hydrogen gas? When jump-starting a car, it is commonly recommended to connect the ground (black) cable to the chassis, not to the battery's black terminal, to avoid a spark igniting the hydrogen and causing an explosion.

Isn't hydrogen produced only while the battery is charging, or at worst, when discharging? If so, this still makes them much safer as they're otherwise inert while not in operation, compared to lithium-polymer which contains materials flammable at all times.

Re: OVH CEO Octave Klaba speaking about the incident [video]

#116
post #103
post #95

Earlier quoted context omitted.

My old company's DC uses FM200 gas which puts fires out without asphyxiating anyone (I'm assuming the experience would be a respiratory workout for anyone caught in it, but it would have cost £20000 to test).

Portable fire extinguishers: - 16 USD (when buying in bulk 200+) [0] - 236 USD ("Marine") [1] 12 Party balloons: - 3 USD [2] [0] https://mengfan.en.made-in-china.com/product/ksNEATWYXcVB/Ch... [1] https://pacificfireandmarine.com/products/sea-fire-model-c-f... [2] https://de.aliexpress.com/item/4000602253794.html

Excellent, cheers! Now we can have a FM200 huffing party after lockdown!

Re: OVH CEO Octave Klaba speaking about the incident [video]

#117
post #24

I think the key issue here is that there wasn't a functioning fire suppresssion system in place. Second question: is such a system required for this kind of operation? Maybe?

I think certain ISO certifications require it.

ISO27K doesn’t require it though, it only requires fire detection, not suppression.

Re: OVH CEO Octave Klaba speaking about the incident [video]

#118

Are there industry options or methods of wiring to allow for a UPS room separate from the actual rooms the racks are stored in? It's almost tradition to have a rack with UPS's in the bottom and then the rest of the space filled with servers or drive arrays. We wouldn't ever think of putting a tiny backup generator in the bottom of every rack, so why do we put a battery storage system there? Also, with the advances in…

For the extreme opposite of that, Google famously trolled everyone 10 years ago by announcing that every one of their servers had its own in-chassis 12V battery: https://www.cnet.com/news/google-uncloaks-once-secret-server...

It sounds rather wasteful to have one device generate mains voltage AC power, only to have another device transform it to lower voltage power and rectify it.

Re: OVH CEO Octave Klaba speaking about the incident [video]

#119

Earlier quoted context omitted.

For the extreme opposite of that, Google famously trolled everyone 10 years ago by announcing that every one of their servers had its own in-chassis 12V battery: https://www.cnet.com/news/google-uncloaks-once-secret-server...

It sounds rather wasteful to have one device generate mains voltage AC power, only to have another device transform it to lower voltage power and rectify it.

I mean chances are they are doing DC distribution.

https://datacenterfrontier.com/google-unveils-48-volt-data-c...

Re: OVH CEO Octave Klaba speaking about the incident [video]

#120
post #65

This would be one of inherient difference between smaller vs. giga players in cloud hosting. AWS/Google/Azure, if this happens, there should only be limited outage to a small fraction of customers. As a matter of fact, Google had such an incident before, and literally no customers (internal and external) noticed.

This is a difference in what you are buying. When you are buying a dedicated server, there isn't exactly a good way to hide that the thing has just gone up in smokes. When you buy a storage API, sure, failure rates go up, latency increases 100x, but after a few hours its probably back to normal. Of course, with the increased abstraction, you get more problems. "Availability zones" are useless when most cloud outages…

AWS is the new IBM. Nobody ever got fired for using AWS.
Post reply on HN