Live data from Hacker News

Apple enabling client-side CSAM scanning on iPhone tomorrow

twitter.com

141–150 of 757 posts

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#141
post #58

I'm really conflicted about this. For context, I deeply hate the abuse of children and I've worked on a contract before that landed 12 human traffickers in custody that were smuggling sex slaves across boarders. I didn't need to know details about the victims in question, but it's understood that they're often teenagers or children. So my initial reaction when reading this Twitter thread was "let's get these bastards…

The NCMEC database that Apple is likely using to match hashes, contains countless non-CSAM pictures that are entirely legal not only in the U.S. but globally. This should be reason enough for you to not support the idea. From day 1, it's matching legal images and phoning home about them. Increasing the scope of scanning is barely a slippery slope, they're already beyond the stated scope of the database.

The database seems legally murky. First of all, who would want to actually manually verify that there aren't any images in it that shouldn't be? If the public can even request to see it, which I doubt, would you be added to a watch list of potentially dangerous people or destroy your own reputation? Who adds images to it and where do they get those images from?

My point is that we have no way to verify the database wouldn't be abused or mistaken and a lot of that rests on the fact that CSAM is not something people want to have to encounter, ever.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#143
Will this work differently depending on what country you are in? For instance, back in 2010 there was that thing about Australia ruling that naked cartoon children count as actual child porn. [1]

It's perfectly legal elsewhere (if a bit weird) to have some Simpsons/whatever mash-up of sexualised images, but if I flew on a plane to the land down under, would I then be flagged?

edit: If this is scanning stuff on your phone automatically, and you have whatsapp or whatever messenger set to save media automatically, then mass texting an image that is considered 'normal' in the sender country, but 'bad' in the recipients, you could get a lot of people flagged just by sending a message.

[1] https://arstechnica.com/tech-policy/news/2010/01/simpsons-po...

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#145

If you like this, I have some other innovations that you may be interested in: * A car that automatically pulls over when a police cruiser attempts to intercept you * A front door that unlocks when a cop knocks * A camera that uses AI to detect and prevent the photography of minors, police, and critical infrastructure * A Smart TV that counts the number of people in your living room to ensure you aren't performing an…

Uneven application of the law seems crucial to keep the system functioning and technology can erode that. Many simple laws, if enforced thoroughly and without prejudice, would become absolutely draconian. It is not even possible for a human to know all the laws we are meant to follow at all times, yet computers can.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#146

If you like this, I have some other innovations that you may be interested in: * A car that automatically pulls over when a police cruiser attempts to intercept you * A front door that unlocks when a cop knocks * A camera that uses AI to detect and prevent the photography of minors, police, and critical infrastructure * A Smart TV that counts the number of people in your living room to ensure you aren't performing an…

> Your own device should not betray you.

Apple devices already betray their "owners", and they've been doing it for a long time.

You can't repair them.

You can't run your own software.

You can't use a better, more compliant web browser.

Businesses have to pay a 30% tax.

Businesses are forced to use login with Apple and forfeit a customer relationship.

Businesses have to dance to appease Apple. Their software gets banned, randomly flagged, or unapproved for deployment, sometimes completely on a whim.

Soon, more iDevices and Apple Pay will lead to further entrenchment. Just like in the movie Demolition Man, everything will eventually be Apple. Your car, your movies, your music, your elected officials.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#147
post #86

Earlier quoted context omitted.

> Unshared data shouldn't be subject to search. Once it's shared, I can make several cases for an automated scan, but a cloud backup of personal media should be kept private. Our control of our own privacy matters. Not for the slippery slope argument or for the false positive argument, but for its own sake. We shouldn't be assuming the worst of people without cause or warrant. I have a much simpler rule: Your device…

I don't think this rule makes any sense, because it just abstracts all the argument into the word "betray". The vast majority of iPhone users won't consider it a betrayal that they can't send images of child abuse, any more than they consider it a betrayal that it doesn't come jailbroken. The victims of child abuse depicted in these images may well have considered it a betrayal by Apple that they allowed their privac…

> The vast majority of iPhone users won't consider it a betrayal that they can't send images of child abuse

Probably neither would child abusers, since as soon as they send an image of child abuse, they're much more likely to be caught than if it had stayed on their phone.

> a betrayal by Apple that they allowed their privacy to be so flagrantly violated on their devices up until now.

"Their" devices? Once Apple sells an iPhone, it no longer belongs to Apple. Taking "betrayal" to mean "didn't plant backdoors on other people's computers to catch your abusers" is stretching that word far beyond reason.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#148
post #120

Earlier quoted context omitted.

No need for hypotheticals, 2020 was a huge win for the police state. The UK and Israel allowed cops to monitor cell phone locations to crack down on unlawful gatherings in private homes. https://www.theguardian.com/world/2020/mar/17/israel-to-trac... The problem with allowing this is that you’re paving the way for future tyrants to use it against us.

> The problem with allowing this is that you’re paving the way for future tyrants to use it against us. It's funny how everybody talk about the future. This is happenning now. Remember how a certain german guy took the power some 90 years ago ? He was elected.

Not your point, but: Technically he was Austrian by birth, stateless sind since 1925 and tried at least 7 times to get German citizenship before elected in 1932.

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#149
post #98
post #95

Earlier quoted context omitted.

So are we talking about images which are not actually CSAM but a reasonable person would consider to be CSAM if they encountered them? Or is it just the README.txt for whatever popular bittorrent client?

A reasonable person would call it a normal picture if they encountered it in isolation. Like I said, content which is not even borderline are included. By both a legal and moralistic standard they're not CSAM. Not even nearly. Of course, this is a minority of the content in the database. But even 1 such image is gross neglect of stated purpose in my book.

But are these photos that are combined in a row with other CP, and thus indicative that if you have this photo, it’s from a CP collection?

Why would I have any content in my phone that would be in that database?

Re: Apple enabling client-side CSAM scanning on iPhone tomorrow

#150
post #53

It's quite easy to extrapolate this and in a few steps end up in a boring dystopia. First it's iPhone photos, then it's all iCloud files, that spills into Macs using iCloud, then it's client side reporting of local Mac files, and somewhere along all other Apple hardware I've filled my home with have received equivalent updates and are phoning home to verify that I don't have files or whatever data they can see or hea…

> "What is the utopian perspective of this which counterbalances the risks for this to be a path worth taking?" Basically victims of rape don't want imagery of their rape freely distributed as pornography. They consider that a violation of their rights. It's interesting how many users in this thread are instinctively siding with the offenders in this, and not the victims. Presumably because they made it through their…

> It's interesting how many users in this thread are instinctively siding with the offenders in this, and not the victims.

That is infantile. Painting people advocating privacy as siding with offenders is highly insulting.

Post reply on HN