Live data from Hacker News

Fire declared in OVH SBG2 datacentre building

travaux.ovh.net

161–170 of 613 posts

Re: Fire declared in OVH SBG2 datacentre building

#161

The classic "lp0 on fire" error message comes to mind: https://en.wikipedia.org/wiki/Lp0_on_fire Really though, I feel truly awful for anyone affected by this. The post recommends implementing a disaster recovery plan. The truth is that most people don't have one. So, let's use this post to talk about Disaster Recovery Plans! Mine: I have 5 servers at OVH (not at SBG) and they all back up to Amazon S3 or Backblaze B2…

Pictures from the fire: https://www.dna.fr/amp/faits-divers-justice/2021/03/10/stras...

Nobody hurt. That's a bit of good news.

Re: Fire declared in OVH SBG2 datacentre building

#162
post #14

Earlier quoted context omitted.

One of my backup servers used to be in the same datacenter as the primary server. I only recently moved it to a different host. It's still in the same city, though, so I'm considering other options. I'm not a big fan of just-make-a-tarball-of-everything-and-upload-it-to-the-cloud backup methodology, I prefer something a bit more incremental. But with Backblaze B2 being so cheap, I might as well just upload tarballs t…

Duplicity is your best bet for incremental backups using B2. I use this for my personal server and it works brilliantly.

I’d stay away from duplicity. I’ve had serious problems with it and large inode counts where it’ll bang the CPU at 100% and never complete.

Have moved to using rdiff-backup over SSH.

Re: Fire declared in OVH SBG2 datacentre building

#164

Earlier quoted context omitted.

> Fire destroyed SBG2 This is crazy. SBG2 was HUGE and if this isn't a translation error on the part of Octave (which I could understand given the stress and ESL) I have a hard time fathoming what kind of fire could destroy a whole facility with nearly 1000 racks of equipment spread out across separated halls. I'm really hoping "destroyed" here means "we lost all power and network core and there's smoke/fire/physical…

If a fire supression kicks in or the fire department shows up with their hoses, would they still say the fire destroyed it or just say destroyed due to fire and water damage? Also, fire suppression system do fail. There was an infamous incident in LA for one of the studios. They built a warehouse to be a tape vault with tapes going back to the 80s. A fire started, but the suppression system failed because there was n…

There's a problem with testing sprinklers: engaging them can be damaging to contents and even structures. So, we're talking about completely emptying the facility, then taking it offline to dry for a time. I've never heard about this being done to anything that was already operational (but I wasn't researching this either).

Re: Fire declared in OVH SBG2 datacentre building

#165

Earlier quoted context omitted.

I've also seen a weird video (lost to time unfortunately), where someone showed that they could yell at their servers in a data centre and introduce errors (or something similar). Was very strange to see, but they had a console up clearly showing that it was having an impact.

https://www.youtube.com/watch?v=tDacjrSCeq4&fmt=18

Because of course it was Bryan :D

Re: Fire declared in OVH SBG2 datacentre building

#166
post #14

Earlier quoted context omitted.

One of my backup servers used to be in the same datacenter as the primary server. I only recently moved it to a different host. It's still in the same city, though, so I'm considering other options. I'm not a big fan of just-make-a-tarball-of-everything-and-upload-it-to-the-cloud backup methodology, I prefer something a bit more incremental. But with Backblaze B2 being so cheap, I might as well just upload tarballs t…

Another option for incremental backups is Restic [0]. It has support to backup to Backblaze B2, Amazon S3 and lots of other places. [0] https://restic.net/

[deleted]

Re: Fire declared in OVH SBG2 datacentre building

#167
post #146

According to the official status page, the whole datacenter is still green http://status.ovh.com/vms/index_sbg2.html

You're completely right. IMO this is the best comment in this whole thread. Their status page must be broken, or it's a lie.

Re: Fire declared in OVH SBG2 datacentre building

#168

Here is some pics of what it looked like before, spg 1-4 , and it’s history https://baxtel.com/data-center/ovh-strasbourg-campus

Is it just my laptop or is only ~40% of vertical screen real-estate dedicated to the actual content? :<

I have the same issue on my XPS 13 (4K screen), the header takes up a good 30% or so of the height of the screen and it's like reading through a mailbox slit.

Re: Fire declared in OVH SBG2 datacentre building

#169
post #121

Earlier quoted context omitted.

> Fire destroyed SBG2 This is crazy. SBG2 was HUGE and if this isn't a translation error on the part of Octave (which I could understand given the stress and ESL) I have a hard time fathoming what kind of fire could destroy a whole facility with nearly 1000 racks of equipment spread out across separated halls. I'm really hoping "destroyed" here means "we lost all power and network core and there's smoke/fire/physical…

No, "destroyed" looks like this: https://mobile.twitter.com/abonin_DNA/status/136953802824345... EDIT a picture from earlier this night https://pbs.twimg.com/media/EwGqV17XMAMF_wa?format=jpg&name=...

I’d say destroyed is an adequate word, yes.

Re: Fire declared in OVH SBG2 datacentre building

#170
post #133
post #103

Video here. This will be Disaster Recovery 101 material. https://mobile.twitter.com/abonin_DNA/status/136953802824345...

Or disaster prevention. I'm curious how their fire suppression system failed so spectacularly..

I think they failed to install it.

They only mention smoke detection: https://www.ovh.com/world/us/about-us/datacenters.xml

Post reply on HN