Earlier quoted context omitted.
Do they share infrastructure?
Yeah, that's what I was wondering. Strange that there is a SPOF for Facebook/Insta/Whatsapp.
Might I ask what’s SPOF?
Facebook Down?
151–160 of 208 posts
Re: Facebook Down?
#152How on earth does EVERYTHING go down like this? It just seems unfathomable to me. Where is the single point of failure?
The global outage drinking game: bad DNS config push - 1 shot routing loop - 2 shots third party advertising your routes - 3 shots power outage at data centre it turns out everything depends on despite decades and millions in engineering to avoid precisely that - 4 shots Wolves ate through fiber - 5 shots And it was a full moon - 6 shots Single service failure, but service has not been restarted in 5 years, and no lo…
DST can be such a hassle.
It affects our reports and change requests.
Re: Facebook Down?
#153Re: Facebook Down?
#154Earlier quoted context omitted.
It could be some rouge admin who actually deleted Facebook.
At that size of a company there's usually blast radius restrictions and per-role permissions. I don't expect anyone has enough rights to "delete Facebook" on their own.
I guarantee you that there are 100+ people who could take Facebook down for 24+ hours if they went rogue.
For example the people responsible for the bootup scripts of Facebook infra could sneak in a "0 0 1 * * /bin/rm -rf ${TEMPDIR}/*" into crontab... They'd set the commit message as "clear out temp monthly" and it would get deployed across the entire fleet till in the first of next month every disk at Facebook gets erased because TEMPDIR isn't defined...
I guess they have enough pending stock to deter them...
Re: Facebook Down?
#155Earlier quoted context omitted.
Yeah, that's what I was wondering. Strange that there is a SPOF for Facebook/Insta/Whatsapp.
I had the impression that they are still run like mostly independent companies who only share some data on the backend.
Yeah that's what I was thinking too, so this is probably DNS related.
Re: Facebook Down?
#156Re: Facebook Down?
#157Quickly, let’s get shit done!