Live data from Hacker News

Apple enabling client-side CSAM scanning on iPhone tomorrow

twitter.com

521–530 of 757 posts

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#521
post #295
post #99

Earlier quoted context omitted.

False positives are clearly astronomically unlikely. Not a real issue. Engineered collisions seem unlikely too. Not impossible. Unless there is a straight up cryptographic defect in the hash algorithm, it seems hard to see how engineered collisions could be made to happen at any scale.

Why do you think that? There are plenty of whitepapers on fooling NNs by changing random pixels by a bit, so that the picture is not meaningfully changed for a person, but the computer will label it very differently. Do note that these are not cryptographic hashes because they have to recognize the picture even when compressed differently, cropped a bit, etc.

Ok, but that’s not the result of a random collision. Those are all carefully engineered.

What is the actual attack you are imagining?

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#522

Earlier quoted context omitted.

Great, so what's the solution? What are you doing to fix it? Do you roll your own silicon? Do you grow your own food (we have no idea what someone could be putting in it)? Are you completely off-grid? Or are you as completely dependent on society writ large as everyone else? Making holier than thou comments about everyone else being sheep isn't helpful or thought provoking. Offer an alternative if it is a bad one (lo…

The solution is to go back to the original spirit of the Internet, when it was a set of open standards connecting people and organizations. Somehow it got forgotten and now we have a bunch of commercial companies giving you the same stuff in exchange for your privacy and who increasingly control everything you do.

Indeed. And, amusingly enough, most of the open standards stuff still exists too.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#523

Earlier quoted context omitted.

Great, so what's the solution? What are you doing to fix it? Do you roll your own silicon? Do you grow your own food (we have no idea what someone could be putting in it)? Are you completely off-grid? Or are you as completely dependent on society writ large as everyone else? Making holier than thou comments about everyone else being sheep isn't helpful or thought provoking. Offer an alternative if it is a bad one (lo…

The solution is to go back to the original spirit of the Internet, when it was a set of open standards connecting people and organizations. Somehow it got forgotten and now we have a bunch of commercial companies giving you the same stuff in exchange for your privacy and who increasingly control everything you do.

The spirit of the internet won’t generate secure hardware or a transparent software stack.

Also, that spirit existed only in an adversary free environment. You may as well say the solution is for everyone to be nice to each other.

The solution is to build new technologies that are privacy preserving, transparent, don’t place trust in a central authority but are resistant to attack.

This is possible but nobody has built it yet.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#524

Earlier quoted context omitted.

This is the big one right here. A malware will definitely be created, almost immediately, that will download files that are intentionally made to match CP - either for the purposes of extortion or just watching the world burn. I'm usually sticking my neck out in defence of more government access to private media than most on HN because of the need to stop CP, but this plan is so naive, and so incredibly irresponsible…

Signal famously implemented, or at least claimed to implement, a rather similar-sounding feature as a countermeasure against the Cellebrite forensics tool: https://signal.org/blog/cellebrite-vulnerabilities/

What is file that they have installed?

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#525

Earlier quoted context omitted.

Yes, because the "huge number of independent people" have never missed any serious bugs or backdoor, and they also verify every piece of equipment you use.

Nothing is ever perfectly secure. It's a question of whom you should trust for a lesser damage.

Yes - and for most people trusting Apple is still a better option, because the ‘community’ option is literally just wishful thinking at this point.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#526
How likely are perceptual hashes to give a false positive? If I take a picture of a tree, how likely is it that a few pixels are going to line up just right in a hashing algorithm and say it might be child porn? How likely is it that law enforcement is going to understand the limitations of this technology? How likely is it that the judicial system will understand the limitations?

I can see law enforcement showing up at my door one day with a search warrant demanding to have a look around, and I would have no idea why they’re there, but they’ll want to look through all my personal belongings.

Worse yet, I might come home from work one day, see my windows broken, see my place has been ransacked and my computers are missing. I would call the police to report a burglary only to hear than that I’m under investigation and they need me to give them the key to decrypt my hard drives.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#527
post #523

Earlier quoted context omitted.

The solution is to go back to the original spirit of the Internet, when it was a set of open standards connecting people and organizations. Somehow it got forgotten and now we have a bunch of commercial companies giving you the same stuff in exchange for your privacy and who increasingly control everything you do.

The spirit of the internet won’t generate secure hardware or a transparent software stack. Also, that spirit existed only in an adversary free environment. You may as well say the solution is for everyone to be nice to each other. The solution is to build new technologies that are privacy preserving, transparent, don’t place trust in a central authority but are resistant to attack . This is possible but nobody has bu…

You could run Mobian or similar on a phone from Purism/Pine/etc.

Problem is you end up with a vastly inferior hardware device that costs nearly as much as an iPhone.

I’m still waiting for my Librem 5 preorder.

Would love to hear if anyone is actually using a Linux phone and enjoying it.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#528
post #523

Earlier quoted context omitted.

The spirit of the internet won’t generate secure hardware or a transparent software stack. Also, that spirit existed only in an adversary free environment. You may as well say the solution is for everyone to be nice to each other. The solution is to build new technologies that are privacy preserving, transparent, don’t place trust in a central authority but are resistant to attack . This is possible but nobody has bu…

You could run Mobian or similar on a phone from Purism/Pine/etc. Problem is you end up with a vastly inferior hardware device that costs nearly as much as an iPhone. I’m still waiting for my Librem 5 preorder. Would love to hear if anyone is actually using a Linux phone and enjoying it.

This is clearly a good thing to do and supporting those projects is great.

So far though, they do nothing to solve the problems we are talking about. The software is not anywhere near audited, and even if it were, you are still interacting with people and services who are using unaudited software.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#529
post #54

Earlier quoted context omitted.

Since you worked on an actual contract catching these sorts of people you are perhaps in a unique position to answer the question: will this sort of blanket surveillance technique in general but also in iOS specifically - actually work to help catch them?

I have direct knowledge of examples of where individuals were arrested and convicted of sharing CP online and they were identified because a previous employer I worked for used PhotoDNA analysis on all user uploaded images. So yeah, this type of thing can catch bad people. I’m still not convinced Apple doing this is a good thing, especially on private media content without a warrant, even though the technology can he…

Look at all the recent findings that have come to light regarding ShotSpotter law enforcement abuse [1] These systems, along with other image and object recognition projects are rife for false positives, bias, and garbage-in-garbage-out. They should in no way be considered trustworthy for criminal accusations let alone arrest.

As mentioned in the twitter thread, how does image hashing & recognition tools such as PhotoDNA handle adversarial attacks?[2][3]

[1] https://news.ycombinator.com/item?id=27959755

[2] https://news.mit.edu/2019/why-did-my-classifier-mistake-turt...

[3] https://towardsdatascience.com/black-box-attacks-on-perceptu...

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#530
post #221

Dear humans, 1) You willingly delegated the decision of what code is allowed to run on your devices to the manufacturer (2009). Smart voices warned you of today's present even then. 2) You willingly got yourself irrevocably vendor-locked by participating in their closed social networks, so that it's almost impossible to leave (2006). 3) You willingly switched over essentially all human communication to said social ne…

Great, so what's the solution? What are you doing to fix it? Do you roll your own silicon? Do you grow your own food (we have no idea what someone could be putting in it)? Are you completely off-grid? Or are you as completely dependent on society writ large as everyone else? Making holier than thou comments about everyone else being sheep isn't helpful or thought provoking. Offer an alternative if it is a bad one (lo…

> Great, so what's the solution?

Seriously? Perhaps heed the warnings? Whenever Apple tightened the reigns, thousand of apologists came to their defense. I wouldn't even have minded if they kept their obedience to personal decisions. But they extended their enlightenment to others.

Post reply on HN