Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OVH Incident in Strasbourg

status.ovh.com

Post reply on HN
Print view View original

111–120 of 207 posts

Re: OVH Incident in Strasbourg

#111

Post by Sami_Lehtinen »

tmikaeld wrote: post #108
Sami_Lehtinen wrote: post #84

Title is misleading. Only RBX and SBG were affected. 06:15 UTC SBG serves failed. OVH network weathermap: http://weathermap.ovh.net Btw. First post: https://news.ycombinator.com/item?id=15660524

Sorry, i didn't see the time stamps! You where first! :D

We're nerds, so how about checking the facts (?). Please explain me if there has been some kind of time anomaly lately or?

My submit timestamp: 07:21:25

Your submit timestamp: 07:28:23

About the title. I did consider the title for a while, because I wasn't sure how bad the situation was. But from my own independent monitoring system I did see that RBX and SBG servers were unavailable. Of course I also did some basic trouble shooting and confirmation work before posting.

Btw. Right now, there's some network traffic present on SBG network. Let's hope that the systems are soon up'n'running.

Re: OVH Incident in Strasbourg

#112

Post by zaarn »

tyingq wrote: post #97
zaarn wrote: post #83

Earlier quoted context omitted.

OVH is rather popular in Europe atleast (alongside Hetzner and 1&1).

The Canadian data center is also a very low cost way to serve the US. I'm an OVH fan. They have their quirks, but the pricing is great. You just make sure you compensate for their quirks with backups and DR plans.

I also like them from a privacy viewpoint.

My data is with me in Europe and the company that has my data is in Europe with me too. If I was using DO or AWS, then my data may be in Europe but the control over the data is in the US, free for all to the three letter agencies and lacking privacy laws there.

Re: OVH Incident in Strasbourg

#113

Post by jlgaddis »

Sami_Lehtinen wrote: post #111
tmikaeld wrote: post #108

Earlier quoted context omitted.

Sorry, i didn't see the time stamps! You where first! :D

We're nerds, so how about checking the facts (?). Please explain me if there has been some kind of time anomaly lately or? My submit timestamp: 07:21:25 Your submit timestamp: 07:28:23 About the title. I did consider the title for a while, because I wasn't sure how bad the situation was. But from my own independent monitoring system I did see that RBX and SBG servers were unavailable. Of course I also did some basic…

Who cares?

Re: OVH Incident in Strasbourg

#114

Post by tmikaeld »

Sami_Lehtinen wrote: post #111
tmikaeld wrote: post #108

Earlier quoted context omitted.

Sorry, i didn't see the time stamps! You where first! :D

We're nerds, so how about checking the facts (?). Please explain me if there has been some kind of time anomaly lately or? My submit timestamp: 07:21:25 Your submit timestamp: 07:28:23 About the title. I did consider the title for a while, because I wasn't sure how bad the situation was. But from my own independent monitoring system I did see that RBX and SBG servers were unavailable. Of course I also did some basic…

Sorry, I didn't know how to check the timestamps.

Yeah, I expected this to clear up in a matter of minutes.

Now it seems to be a shitstorm of historic proportions...

Re: OVH Incident in Strasbourg

#116

Post by lloeki »

gyaru wrote: post #105
wiz21c wrote: post #104

Damn, every emergency power supply I have encountered (the big ones with fuel and hundreds of batteries) always fail to start when they have to... Why is that ?

People not actually testing emergency equipment.

Happens: our generators have been tested lately, and both failed. Testing matters, hope is not a plan.

Same goes for backups: you don't have backups until you tried to restore them.

Re: OVH Incident in Strasbourg

#118

Post by Cthulhu_ »

wiz21c wrote: post #104

Damn, every emergency power supply I have encountered (the big ones with fuel and hundreds of batteries) always fail to start when they have to... Why is that ?

Lack of testing; ideally you throw a switch once a month or so to make sure the UPSes work and the generators power on, but I can imagine it's something you'd rather not do, if it doesn't work you've just intentionally borked things for your customers. Still, it is something that datacenters should do, do it a few times before you have any customers, keep doing it. Maybe offer a discount (if it's a new datacenter for an existing provider, like AWS or whatever) for the first couple months, indicating that emergency power has not yet been tested properly.

There's tooling available and running at some of the larger companies (like Netflix) called Chaos Monkey, which triggers random outages constantly to determine if the system is resilient and self-healing.

Re: OVH Incident in Strasbourg

#119

Post by CydeWeys »

wiz21c wrote: post #104

Damn, every emergency power supply I have encountered (the big ones with fuel and hundreds of batteries) always fail to start when they have to... Why is that ?

It's a hard problem to solve. We're talking about machines that are required to deliver massive load but that aren't even used once in a given year.
Post reply on HN