Live data from Hacker News

Non-Consensual Intimate Image Pilot

newsroom.fb.com

101–110 of 184 posts

Re: Non-Consensual Intimate Image Pilot

#101
post #38

As other has pointed out, this is extremely creepy. The easiest solution would have been this one: - The user uses a JS solution to hash the images on the client, without the image being uploaded - She compiles a form with additional information (e.g: capture her account, reasons for uploading, suspect person sharing the picture) - The picture is saved in the DB as un-verified revenge porn. - The first time someone u…

You lost me at JS.

Re: Non-Consensual Intimate Image Pilot

#102
post #89

Earlier quoted context omitted.

> I can imagine images of people that aren't "non-consensual intimate images" that they'd reasonably still like to be able to block being posted. If I take a photo of a public landscape and you happen to be there, do you have the right to prevent me from publishing it unaltered? Keep in mind: you're not the primary subject (and no reasonable person would believe that you were) nor owner of the photo. Your likeness is…

Excellent! Then it should be short work for you to photoshop my face out so it won't be blocked. Everybody wins.

I 100% prefer the status quo to the idea proposed here. I understand that some people would rather not be pictured, but I don't think that should override the right of others to make images in public spaces (or private spaces with suitable permission).

Re: Non-Consensual Intimate Image Pilot

#103
post #34

Earlier quoted context omitted.

Yeah I'm curious how their hashing mechanism works. Like, is it a straight up sha hash of the image or something a little more sophisticated that wouldn't be fooled by minor edits? Though in the latter case can that even technically be considered hashing? I guess it all depends on how they're doing it which brings us back to my first question...

It is called PhotoDNA and was developed by Microsoft. This is the same tech that is used to find child porn images even when people go to various lengths to prevent simple hashing from being able to determine photo similarity. It works surprisingly well at the task from what I have seen/heard.

Photo dna is just one of a class of algorithms called perceptual image hashes (there are also perceptual audio and video hash algorithms). They by no means invented the technique, just one particular branded implementation of it.

Re: Non-Consensual Intimate Image Pilot

#104
post #95
post #78

Earlier quoted context omitted.

Honestly, I doubt that most of these sorts of algorithms would survive concerted attacks – that's why they tend to be closely guarded. Alex Stamos (Facebook's CISO) implies this is why they can't do it client-side: https://twitter.com/alexstamos/status/928646228472078336

From when security through obscurity is a good idea?

You should go put a $100 bill on the dashboard of your car along with your laptop on the front seat. Report back the results.

snark-mode off: We use obscurity every day and its a completely valid layer of security.

Re: Non-Consensual Intimate Image Pilot

#105
post #97

Earlier quoted context omitted.

Excellent! Then it should be short work for you to photoshop my face out so it won't be blocked. Everybody wins.

Why is Facebook obligated to fulfill your desires for privacy by censoring content you have no legal claim to?

Consider that this situation could extend or apply to humans, animals, or even plants.

Does a rhinocerous have a right to be forgotten?

https://www.reddit.com/r/dredmorbius/comments/25ll1v/does_a_...

Re: Non-Consensual Intimate Image Pilot

#106
post #100

The better solution is to have the image hashed and NOT sent to facebook. If the hash matches an existing image [A]. If the hash isn't found [B]. [A]: human can review the image they already have [B]: Facebook waits until someone uploads an image that matches and then reviews the image (as normal) but with a marker alerting the problem. The benefit is that people NOT affected won't have to upload lots of images of th…

Kind of weird that they didn't do things this way as they supposedly already use hashing to flag child porn cf. http://www.wired.co.uk/article/iwf-hash-lists-child-abuse-im...

That system works the same way as what they're implementing. Someone reviews the raw image and enters the hash into the system.

Re: Non-Consensual Intimate Image Pilot

#107
post #78
post #52

Earlier quoted context omitted.

PhotoDNA would be an option, I imagine. Or at least something similar! https://en.wikipedia.org/wiki/PhotoDNA

Honestly, I doubt that most of these sorts of algorithms would survive concerted attacks – that's why they tend to be closely guarded. Alex Stamos (Facebook's CISO) implies this is why they can't do it client-side: https://twitter.com/alexstamos/status/928646228472078336

The attacker isn’t a national state adversary. The attacker is a vengeful ex. The chances of such attacker even been aware of what hashing is, is close to zero.

Whoever designed this system is probably heavy on security, but low on product.

Re: Non-Consensual Intimate Image Pilot

#108
post #41
post #38

As other has pointed out, this is extremely creepy. The easiest solution would have been this one: - The user uses a JS solution to hash the images on the client, without the image being uploaded - She compiles a form with additional information (e.g: capture her account, reasons for uploading, suspect person sharing the picture) - The picture is saved in the DB as un-verified revenge porn. - The first time someone u…

Now figure out a way to do step #1 (user does a hash client-side) without making it trivial for someone else to create a filter that adds enough noise to invalidate step #4 (uploaded pics that match a hash are quarantined.)

Why would you need to? We are talking about vengeful ex-es here. It’s possible to bypass this trivially by uploading it to another image sharing service, so the goal should be defection in the general case; not try and protect against the 0.1% that even know what a perceptual hash is.

Re: Non-Consensual Intimate Image Pilot

#110

The better solution is to have the image hashed and NOT sent to facebook. If the hash matches an existing image [A]. If the hash isn't found [B]. [A]: human can review the image they already have [B]: Facebook waits until someone uploads an image that matches and then reviews the image (as normal) but with a marker alerting the problem. The benefit is that people NOT affected won't have to upload lots of images of th…

The obvious reason why Facebook didn't go down this path is one of scale - It's easy (and altogether likely) for an attacker to pollute the hashes with innocuous pictures. But, even more importantly, once you reveal your hashing system, it's relatively trivial for people to work around them and modify the pictures in such a way as to render the hashing system useless. Has to be done server side for these reasons.

If “scale” is the reason they insist that explicit images be uploaded directly to them instead of hashed beforehand, then they really don’t care about this program enough to do it right.

They can easily scale this by allowing hash uploads, using a trivial client side classifier to guess at whether an image is actually served well by this technology, and confirm positives with CV after a bad actor reposts their media on the site, with human intervention only on the fringes.

Post reply on HN