Live data from Hacker News

Apple plans to scan US iPhones for child abuse imagery

ft.com

91–100 of 390 posts

Re: Apple plans to scan US iPhones for child abuse imagery

#91

This could backfire in a huge way. I think a lot of people, even EFF/privacy focused people are fine with a private company doing CSAM detection (or anything really) on uploaded user content since it is actually voluntary. Now that CSAM detection is being deployed to user devices including those previously sold without it, there's a motivation to circumvent/block it. Unless Apple is doing CSAM scanning 100% inside a…

> All it takes is one security researcher to publish a tool that creates millions of false-positives for the current dataset/model used by Apple & others to be useless. And even better: someone could create false-positives and just send them to people, or put them on websites. While you're watching funny kittens tumbling around, your iphone is calling the cops on you because it thinks you're watching child porn.

A high rate of false positives will create distrust in the system, and ultimately make it less effective since no one will take it seriously.

Re: Apple plans to scan US iPhones for child abuse imagery

#92
post #31

I really don't see how this is going to end well, there could be perfectly innocent photos on someone's phone of their own children doing perfectly normal things that kids do. Like a kid running butt naked around the house, or a photo of something like a rash that is sent to a nurse friend for advice on what it is etc. I'm all for protecting children from being abused, but how are they going to filter what is normal…

> perfectly innocent photos on someone's phone of their own children They are using a library of human verified images to compare the hashes. Probably similar to PhotoDNA[0]. There can be false positives, but AFAIK the algorithms are not trying to identify naked children, but comparing 2 similar image hashes. [0] - https://en.wikipedia.org/wiki/PhotoDNA

I bet(or know...) the people who verify those images don't get paid anywhere near enough.

Re: Apple plans to scan US iPhones for child abuse imagery

#93

I really don't see how this is going to end well, there could be perfectly innocent photos on someone's phone of their own children doing perfectly normal things that kids do. Like a kid running butt naked around the house, or a photo of something like a rash that is sent to a nurse friend for advice on what it is etc. I'm all for protecting children from being abused, but how are they going to filter what is normal…

> Like a kid running butt naked around the house... Thought it was buck naked — but that works too. :-)

https://brians.wsu.edu/2016/05/19/butt/

Re: Apple plans to scan US iPhones for child abuse imagery

#94

Imagine if Microsoft does this with Windows, lots of people would get arrested rightly so. But like some people say this can be dangerous because evidence can be planted on your device. I remember reading articles how through torrent clients files could be planted but I never actually saw it in the wild.

A good reminder to turn off AirDrop "Auto Accept from Everyone"

Re: Apple plans to scan US iPhones for child abuse imagery

#95
post #11

Whose to say what is abuse? Are Caesar Milan tactics on a child abuse? This is outright dangerous beyond belief. Nobody is gonna wanna be a parent if you have to worry about your kid being mad at you and then posts something like that. IIRC there was a teenage girl that lied about her father molesting her back in the 2000s. No evidence, just pure hearsay. Dude was locked up for like 10 years. Now imagine that on a gr…

That would be false testimony, not hearsay. Hearsay ("John Smith told me he heard MeinBlut kidnapped the Lindbergh baby") is not allowed. Witnesses lying about what they saw and or participated in is allowed, although it can be lies. Sorry, and as for "what is abuse", these are looking for exploited children. There are a lot of questions here, the morality of mass surveillance, the risk factors due to hash collisions…

I don't think society can function without harsh penalties for child abuse, and I think thats a widely held belief everyone agrees with.

I do think your comment is conflicting though. The fuzziness of 'is this abuse' is real because collisions can occur, mass surveillance never goes in reverse, etc.

Re: Apple plans to scan US iPhones for child abuse imagery

#96
post #31

I really don't see how this is going to end well, there could be perfectly innocent photos on someone's phone of their own children doing perfectly normal things that kids do. Like a kid running butt naked around the house, or a photo of something like a rash that is sent to a nurse friend for advice on what it is etc. I'm all for protecting children from being abused, but how are they going to filter what is normal…

> perfectly innocent photos on someone's phone of their own children They are using a library of human verified images to compare the hashes. Probably similar to PhotoDNA[0]. There can be false positives, but AFAIK the algorithms are not trying to identify naked children, but comparing 2 similar image hashes. [0] - https://en.wikipedia.org/wiki/PhotoDNA

[deleted]

Re: Apple plans to scan US iPhones for child abuse imagery

#97
This will enable Apple to send hashes of matching fingerprint and face scans to their online database. This also completely disabled their argument that their product is safe because the data remains encrypted on your device. Instead of passing the data to the spy service they are sending a report on data to the cloud which will allowed to be much more opaque and misleading.

I just ordered a Iphone 12 Mini to replace an Iphone SE, but now I’m going to return it. No amount of cool tech in a product is worth enabling this slippery slope against human privacy rights.

Re: Apple plans to scan US iPhones for child abuse imagery

#99

Earlier quoted context omitted.

> "The odds of This number is equivalent to generating 1 billion UUIDs per second for about 85 years." If we're talking about random files, sure. What if the files are intentionally created to match the desired hash? The malicious actor doing this could be a private party intending to disrupt your life, but it could also be law enforcement as a means of gaining access to your device when it would otherwise require a…

Couldn't someone that motivated come up with a dozen other ways to frame someone? This seems a little alarmist to me.

I hope you don't ever run afoul of an internet mob from somewhere like 4chan! They might SWAT you while DDOSing your IP and doxing you then emailing your iphone dozens of photos that collide with CSAM perceptual hashes.

Re: Apple plans to scan US iPhones for child abuse imagery

#100
post #91

Earlier quoted context omitted.

> All it takes is one security researcher to publish a tool that creates millions of false-positives for the current dataset/model used by Apple & others to be useless. And even better: someone could create false-positives and just send them to people, or put them on websites. While you're watching funny kittens tumbling around, your iphone is calling the cops on you because it thinks you're watching child porn.

A high rate of false positives will create distrust in the system, and ultimately make it less effective since no one will take it seriously.

Could be used to target specific individuals and discredit them (e.g. critics of government).
Post reply on HN