Live data from Hacker News

Meta quickly detects silent data corruptions at scale

engineering.fb.com

21–30 of 104 posts

Re: Meta quickly detects silent data corruptions at scale

#21

It would be better if Meta would focus on detecting spam at scale. I put a desk chair on Marketplace last Friday, and got 8 messages that were actually scams. These were trying to "schedule" a Fedex/DHL pickup, and would redirect me to fake branded websites that were requesting my personal details and bank account. This was so obviously fake it baffled me Meta can't detect these automatically. I am also getting multi…

Somehow I knew it was going to be a bit.ly link before opening the image

Re: Meta quickly detects silent data corruptions at scale

#22

It would be better if Meta would focus on detecting spam at scale. I put a desk chair on Marketplace last Friday, and got 8 messages that were actually scams. These were trying to "schedule" a Fedex/DHL pickup, and would redirect me to fake branded websites that were requesting my personal details and bank account. This was so obviously fake it baffled me Meta can't detect these automatically. I am also getting multi…

It’s a different team, with a different skillset, that would be responsible for that. Big companies can focus on more than one thing at a time.

Re: Meta quickly detects silent data corruptions at scale

#23

To be clear, this is about corruption in the CPU/GPU/memory complex. There's a whole separate set of techniques (some of which I worked on) to detect and correct data corruption on disk.

I'm in the same boat and my takeaway is that the vast majority of a "silent" on-disk corruption actually happens on the way to the storage, i.e. the data gets corrupted in some RAM it passes through and then just ends up being written out in corrupted state. This is because, virtually all modern drives implement per-sector FEC coding, so if a bit does flip on the disk, you will either get back original data (now FEC-corrected) or you will get a read error.

That is, the so-called "bitrot" phenomenon is largely mis-attributed. Bitrot doesn't happen at rest. It happens in transit.

Re: Meta quickly detects silent data corruptions at scale

#24

It would be better if Meta would focus on detecting spam at scale. I put a desk chair on Marketplace last Friday, and got 8 messages that were actually scams. These were trying to "schedule" a Fedex/DHL pickup, and would redirect me to fake branded websites that were requesting my personal details and bank account. This was so obviously fake it baffled me Meta can't detect these automatically. I am also getting multi…

I think that large tech companies giving a snapshot of what cool or interesting things they do is great but if there are bigger problems that don’t seem to have that kind of focus it just feels like a marketing / recruiting post (which isn’t that bad). But, the problem would be if they made public antispam systems they can’t give that to spammers which presents as a catch22. Also if you have humans in the loop to evade a spam system it is basically impossible .

Re: Meta quickly detects silent data corruptions at scale

#25
post #19

Earlier quoted context omitted.

I will always say VR, I will never say "metaverse". Their branding move was bold, yet unconvincing.

Vr is a subset of the ‘metaverse’. The metaverse isn’t really something new. It’s just a rebranding of the portion of our lives that are contained within the digital realm. On top of that there are obviously ideas for how to adapt and grow that space, which is all to be seen

“It’s just a rebranding of the portion of our lives that are contained within the digital realm.”

none of my life is “contained” within shitbook

Re: Meta quickly detects silent data corruptions at scale

#26

Interestingly, this site fails ungracefully (HTTP error code 500) when I try to visit from NordVPN, even after cycling through a few IP addresses. I’m noticing more and more sites block all VPN track. I get why, but it’s not good.

I've noticed this is quite popular among the kings of cargo-cult security: banking websites. I can only hope the proliferation of VPN-gating is more contained compared to the recent (banking-led) upswing in Android root-checks.

This type of security theater can be easily bypassed by any determined attacker and thus only serves to deter honest users.

Re: Meta quickly detects silent data corruptions at scale

#27

It would be better if Meta would focus on detecting spam at scale. I put a desk chair on Marketplace last Friday, and got 8 messages that were actually scams. These were trying to "schedule" a Fedex/DHL pickup, and would redirect me to fake branded websites that were requesting my personal details and bank account. This was so obviously fake it baffled me Meta can't detect these automatically. I am also getting multi…

[deleted]

Re: Meta quickly detects silent data corruptions at scale

#28

Completely off-topic digression: I still think the name change to “Meta” is a big mistake. Subjectively, for some reason I just really dislike the name. More objectively, the branding is very muddled, e.g: serving an “Engineering at Meta” blog post on fb.com. Often with these things it’s just about time; it feels wrong because you’re just not used to the change yet. Maybe that will happen, but it’s been months now. U…

[deleted]

Re: Meta quickly detects silent data corruptions at scale

#29

It would be better if Meta would focus on detecting spam at scale. I put a desk chair on Marketplace last Friday, and got 8 messages that were actually scams. These were trying to "schedule" a Fedex/DHL pickup, and would redirect me to fake branded websites that were requesting my personal details and bank account. This was so obviously fake it baffled me Meta can't detect these automatically. I am also getting multi…

They ban like 1.7B account per quarter ignoring those blocked at registration. Isn't that focus?

Subjectively too I also see so much less bot activity on Facebook than I do on any other social media.

Re: Meta quickly detects silent data corruptions at scale

#30
post #7

The scale at which Meta operates at really boggles my mind. I work with an ex facebook guy who was on the infra side of things and the numbers he told me.. I couldn't even imagine. And I'm working on the order of magnitude of 100m/h, but still, completely different set of challenges.

Same. I remember asking one guy at FB the process to ask for a new server. He said he can't even open a request for anything less than a thousand boxes. The largest fleet I'd worked on at that point was 12... different worlds.
Post reply on HN