341–350 of 351 posts
Earlier quoted context omitted.
Facebook is not a “PHP codebase.” I’d guess that fewer than 0.01% of CPU cycles at Facebook are used by PHP.
Isn’t a significant amount of the codebase in Hack, a PHP derivative?
Earlier quoted context omitted.
"The storm"? It's sunny in the Bay Area for the first time in I don't know how long. I imagine it's nice in other parts of the world as well, other than where this localized "storm" is.
You missed the bomb cyclone that's happening right now in half the country?
Earlier quoted context omitted.
Isn’t a significant amount of the codebase in Hack, a PHP derivative?
C++ is the most popular language at Facebook, I know that one for sure. They used to run PHP on HipHop VM which was written in C++, but now they transpile PHP to C++.
EDIT: apparently, though, HHVM stopped supporting PHP itself last month; now it only supports Hack. I'm not familiar enough with Hack to know how much it actually deviates from / improves upon PHP.
Can you imagine if Twitter and Google went down at the same time? People would be reactivating their Facebook accounts and having to sift through conspiracy theory posts about Hillary Clinton still just to figure out what was going on. Edit: The points on this post keep going up and down every time I check these comments. Yes, it was sarcasm, I was joking, but I was trying to point out that most people rely on a smal…
I'm more worried of all of it going down at the same time.
Earlier quoted context omitted.
Private post Morten: The NSA middleware we are required to run (that took time to deploy to each of our social partners) is breaking something so let’s revert. Public post Mortem: Entirely believable technical cause.
I don't think it's the NSA this time, for once they don't have to do deep package analysis or install any MITM device since they get the whole info in bulk, maybe it's just a 400-pound hacker.
So yesterday Google had a major (and out of character) outage across its apps, and today Facebook has a major (and also out of character) outage across its apps. I can't wait to see the RCA for both of these and if they're related.
Private post Morten: The NSA middleware we are required to run (that took time to deploy to each of our social partners) is breaking something so let’s revert. Public post Mortem: Entirely believable technical cause.
Yet another alternative: Third World War has just started, and this was the first battle.
Earlier quoted context omitted.
I wonder how Jimmy Carter feels about his namesake being used to wiretap the world? https://www.washingtonpost.com/news/post-politics/wp/2014/03...
It was a known FU to carter...
https://en.wikipedia.org/wiki/USS_Jimmy_Carter
I don't think he made any pre-Snowden comments on mass surveillance?
Could this be related to the storm? I was out shoveling, and came back in to my phone blowing up. Our systems at IronMountain (formerly Fortrust) in Denver all rebooted at once. These are all on redundant power, each systems redundant power supplies connecting to different circuits entering the cabinet, and those two circuits fed from 3 PDUs (two separate, one share). Each of those is supposed to be fed by a separate…
No, FB datacenters are geographically diverse. They do run quarterly 'storms' where a datacenter is shut down to test failover and resiliency. I have no idea if today is one of those days, since I left last year.
Could this be related to the storm? I was out shoveling, and came back in to my phone blowing up. Our systems at IronMountain (formerly Fortrust) in Denver all rebooted at once. These are all on redundant power, each systems redundant power supplies connecting to different circuits entering the cabinet, and those two circuits fed from 3 PDUs (two separate, one share). Each of those is supposed to be fed by a separate…
> "We are trying to gather information, we are making a bunch of client phone calls, we will know after we make those calls." I think that is a yes, and he getting ahead by saying "Yes and we have no idea why or ETA so let us do our job". Granted, they should have a status page.
On the other hand, I need information to be able to do my job: Is this only our cabinet having problems and I need to start rolling to the datacenter (in the middle of a giant blizzard)? Is this possibly some sort of problem with our own power infrastructure? Is something on fire (an EPO triggered by fire could cause this)? Did the roof cave in under the weight of the snow we are getting? Is the power stabilized or is there some indication that power might be up and down?
In short, I need answers to: Do I need to gracefully take down my site to prevent lost transactions and database corruption? Do I need to switch to our backup site?
For context: All of our servers powering off at once and then back on shouldn't be possible. It should require the failure of at least 3 independent pieces of equipment (except at the breaker panel or in our cabinet where it could be only two failures). It is extremely unusual for this to happen, first time it's happened for me and I've been in that facility since 2004.
So, yes, I respect that you need to do your job. But I also need to do my job.
Plus, I'm pretty sure the guy answering the trouble line, his job WAS talking with the customers. The people working the problem likely didn't include him. This is a huge data center run by a ginormous company. I don't think I was taking him away from twisting a wrench. :-)
Earlier quoted context omitted.
A nuclear war could take out an AWS region and we'd get an "increased error rates" informational message.
Are you saying that a cold-war-era system like the internet/arpanet meant to survive a nuclear war might be vulnerable to an attack if we take all the code and data and store it in the same place? :-)