Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook Down?

facebook.com

Post reply on HN
Print view View original

101–110 of 208 posts

Re: Facebook Down?

#102

Post by lovedswain »

grensley wrote: post #27

How on earth does EVERYTHING go down like this? It just seems unfathomable to me. Where is the single point of failure?

The global outage drinking game:

bad DNS config push - 1 shot

routing loop - 2 shots

third party advertising your routes - 3 shots

power outage at data centre it turns out everything depends on despite decades and millions in engineering to avoid precisely that - 4 shots

Wolves ate through fiber - 5 shots

And it was a full moon - 6 shots

Single service failure, but service has not been restarted in 5 years, and no longer restarts in any documented fashion - 7 shots

And service developers left the company to found a startup - 8 shots

Expired internal SSL certificate - 9 shots

Daylight savings changeover-induced database corruption - 10 shots

Windows Update - 11 shots

Re: Facebook Down?

#103

Post by vesinisa »

chaos_emergent wrote: post #46
grensley wrote: post #27

How on earth does EVERYTHING go down like this? It just seems unfathomable to me. Where is the single point of failure?

Probably an intern doing something dumb.

If an intern can bring down the whole presence of your company online it's not the intern who is dumb.

Re: Facebook Down?

#104

Post by menocchio2021 »

Funny!

before FB got down, I was seeing a disscuion on how "bad" fb (and other social networks are) the same usual BS where people complaining but still keep using it!

I am curious how they will react now?! How all those "drama queens" will behave now when all their "reputation as moderators" is at risk of dissapereance!

Re: Facebook Down?

#105

Post by reaperducer »

css wrote: post #65
kickling wrote: post #4

Love the status page right now. https://developers.facebook.com/status/dashboard/ PS. Instagram app/site, whatsapp.com, messenger.com, oculus.com also down, anything else? UPDATE: Everything back up! (Even the status page)

It loads fine for me and shows no downtime or incidents. It even says "Facebook Platform is Healthy"

Not here. Status page still does not load at all.

Re: Facebook Down?

#106

Post by nonameiguess »

grensley wrote: post #27

How on earth does EVERYTHING go down like this? It just seems unfathomable to me. Where is the single point of failure?

Large scale network partitioning can happen. Data center ingress/egress can go down. If you shard to multiple data centers, it's still possible for an entire autonomous system to have an interconnect with a different AS break. That is rare as hell with the actual Internet because of all the route redundancy even between ASes, but I've seen it happen on more specialized networks. For a few days last year, the entire western half of the US was cutoff from the eastern half on Raytheon's internal TS network because someone digging a hole somewhere accidentally cut the wrong fiber line.
Post reply on HN