Live data from Hacker News

Non-Consensual Intimate Image Pilot

newsroom.fb.com

11–20 of 184 posts

Re: Non-Consensual Intimate Image Pilot

#11
post #8
post #4

This is insane. If they can fingerprint your images, why can't they provide a tool for processing the image and sending the fingerprint only? Can you imagine how big of a target a tailor made database of blackmail material linked to facebook accounts would be?

If you can send only the fingerprint, what stops you from uploading photos you are not in? A better idea may be an uploading tool where you can obscure some parts for verification.

Seems like anybody can upload any body.

Re: Non-Consensual Intimate Image Pilot

#12
Ok, so now all the harassers out there are just going to edit a few pixels on the images before uploading, so the hash isn't caught. All the same tricks use don YouTube to avoid the copyright bot, will work here as well.

Re: Non-Consensual Intimate Image Pilot

#13
To everyone asking why they need a human to review to image before hashing it: it's currently the only way to prevent abuse of this system -- Without this, everyone would upload random images that would get taken down, effectively mass-trolling

Re: Non-Consensual Intimate Image Pilot

#14
post #10

isn't nudity generally banned on facebook anyway? I didn't realise this would/could be an issue. Unless they're talking about private communications in eg. messenger.

Revenge porn isn't all about nudity. And this does cover Messenger (and Instagram). The point isn't to get an image taken down after the fact, but to proactively block it from being posted or sent in the first place.

I thought facebook would run posted images through their AI nudity filter before allowing them to be posted? It's good that this covers messenger as I've read stories in the past of people being blackmailed over it, but surely there must be a better way than asking people to upload their private images to facebook. Plus, what's the case with younger facebook members? Do they upload the images and are therefore sharing child pornography with facebook, or not upload and don't get to be protected from revenge porn postings, when they're one of the most at-risk demographics?

Re: Non-Consensual Intimate Image Pilot

#16
post #4

This is insane. If they can fingerprint your images, why can't they provide a tool for processing the image and sending the fingerprint only? Can you imagine how big of a target a tailor made database of blackmail material linked to facebook accounts would be?

They could just send fingerprints, sure.

The problem is that you presumably want the image to be blocked immediately upon upload.

But facebook is worried that people will abuse the system, and they don't want images to be instantly wrongfully blocked until someone can review it.

Abuse-resistance. Instant blocking. Perfect privacy. Pick two. There's no perfect solution.

Re: Non-Consensual Intimate Image Pilot

#17
post #3

Tricky. Sending them all of your potentially leaked embarrassing photos so that they can store them and prevent them from leaking out. If they get hacked now someone has a lifetime supply of blackmail material. Not clear if the cure is better than the ailment.

From the fine article: "We store the photo hash—not the photo—to prevent someone from uploading the photo in the future. If someone tries to upload the image to our platform, like all photos on Facebook, it is run through a database of these hashes and if it matches we do not allow it to be posted or shared."

But you are sending an image to yourself in Messenger which DOES normally keep an image. It doesn't say here that they explicitly delete the message you sent via Messenger, does it? Perhaps you have to delete that for yourself? And do they take back-ups of Messenger data in which this photo may now be in?

Seems like a very awkward flow to forcefully repurpose Messenger to do something it shouldn't be doing.

Re: Non-Consensual Intimate Image Pilot

#19

Why do they need a human representative to hash the image? I don't understand why this can't all be done automatically. Creeps me out that a real human would see intimate pictures before they block them.

Because otherwise people will just submit random picture for the lulz

Re: Non-Consensual Intimate Image Pilot

#20

Why do they need a human representative to hash the image? I don't understand why this can't all be done automatically. Creeps me out that a real human would see intimate pictures before they block them.

I'm _assuming_ the only reason a human representative is doing this is so the system doesn't get abused. Like say I upload a photo claiming it is of myself but it's actually the advertisement a competitor of mine is using. If they didn't verify it was something that SHOULD be removed they'd automatically remove my competitor's posting of their advertisement every time they posted it.

Granted I really wish this was all done on the client so Facebook didn't gain access to the images themselves but I'm not sure of a good way around it to verify the image is something they should remove and not an abuse of the system.

Post reply on HN