Live data from Hacker News

Apple plans to scan US iPhones for child abuse imagery

ft.com

221–230 of 390 posts

Re: Apple plans to scan US iPhones for child abuse imagery

#221

While they are at it they should up the ante and also add COVID misinformation filters, so that a phone refuses to save it and/or doesn't send it anywhere. Would be very topical. There is also racism and other almost universally recognized wrongthink. If you decide to police offline activity as if it's a cloud platform, why not implement all the online platform's automatic content filtering/censorship? /s

COVID "misinformation", anti-lockdown protests, any movements that are commonly labelled as domestic terrorism (boog bois, antifa, maybe even BLM; in China it will be anything that speaks out against the CCP, etc) - the potential for abuse is massive. Anyone that trusts the feds to do the right thing here is incredibly naive. They get to operate a black-box database; if your phone has any photos that match an entry i…

>if your phone has any photos that match an entry in the db

I believe it's not "an entry in the db" but a neural classifier. The article calls it "neuralMatch". So it's much more general than a limited number of known images.

Re: Apple plans to scan US iPhones for child abuse imagery

#222
post #217

Earlier quoted context omitted.

As far as I’m aware, the laws which require cloud service operators to scan for CSAM have been on the books for a long time, and none of the usual orgs have raised a constitutional challenge to them. I’m not a legal expert either, though.

But that's the big difference, cloud providers are scanning the data they hold on their device. Your iphone is not Apple's device. Cloud providers have a liability if they knowingly store illegal content, the data is stored on their property, Apple does not, it is your property. It's like if Ford was going to scan what you store in the trunk of your car.

The headline is misleading. The rumored change only impacts photos your device is uploading to iCloud, and it seems like Apple servers are a necessary part of the protocol.

Re: Apple plans to scan US iPhones for child abuse imagery

#223
post #213

Earlier quoted context omitted.

> Child abusers evolve and are very happy if law enforcement doesn't. Yes. And now they will evolve by developing a simple system to modify pixels in images when they copy and transmit that will easily defeat this hashing system. The only effect this will have is that moral panickers like you will have got everybody's privacy invaded over your moral panic of the day.

Again, you don't appear to know how this works. Look up fuzzy hash, i even mentioned it in the comment.

I have a hard time believing that this algorithm will be able to resist simple image manipulations while still being sensitive enough to avoid false positives.

Re: Apple plans to scan US iPhones for child abuse imagery

#225

I really don't see how this is going to end well, there could be perfectly innocent photos on someone's phone of their own children doing perfectly normal things that kids do. Like a kid running butt naked around the house, or a photo of something like a rash that is sent to a nurse friend for advice on what it is etc. I'm all for protecting children from being abused, but how are they going to filter what is normal…

Yes, not no to mention the gulf that exist between american culture of what is innocent and acceptable and the rest of the world. If we apply the american paranoid standards to the rest of the world, i am pretty sure we will have plenty of false positives.

Re: Apple plans to scan US iPhones for child abuse imagery

#226
post #172
post #124

Earlier quoted context omitted.

Don't worry, AI is very good at these things and never makes mistakes. It is so advanced it even understands nuance and complex communication mechanisms like sarcasm in text, even if it's only a single sentence to contrast! It will be able to know exactly the context of each image and it will affect only the sickos. We're also working on watching your face through the camera to see your true expression when viewing t…

There is zero AI classification involved, it’s a lookup vs hashes of known child porn images. You would need a hash collision, misidentified photo in the dataset, or legitimate use case to end up with a false positive.

Zero AI involved? Simple hashes? Source needed. From what I read, you are making false claims.

Re: Apple plans to scan US iPhones for child abuse imagery

#227

Earlier quoted context omitted.

You think Facebook and Google Photos should be the goal for privacy standards? You and I are practically in different universes then, philosophically. You're also being naive by swallowing the "it's only iCloud" justification. There is a clear intent to progress to scanning all local photos. After all, if photos must be match those of a government child abuse database, and any matches trigger manual review, what woul…

What advice would you give Apple if they’re faced with a legitimate government asking it to comply with the laws they have instituted in the society Apple wants to do business? I don’t appreciate you calling me naive. There isn’t clear intent to scanning all local photos. In fact, it seems like the system was deliberately designed to only work with photos that are being uploaded to iCloud.

> What advice would you give Apple if they’re faced with a legitimate government asking it to comply with the laws they have instituted in the society Apple wants to do business?

It is good advice not to carry around huge amounts of money on your wallet. Someone might want it and have the power to get it.

Same with megacorps constructing and bragging about tools for oppression:

Better not do it.

Otherwise just be prepared that China will demand that you also upload their hashes of extremely bad photos - and one or two guys they want to get hold of.

It is kind of a Manhattan project for digital privacy - it is meant to bring a quick end to a actual real problem we have - but it has the potential to become a shadow over society for decades if not centuries to come.

Re: Apple plans to scan US iPhones for child abuse imagery

#228

> ...ongoing demands from governments, law enforcement agencies and child safety campaigners for more assistance in criminal investigations, including terrorism and child pornography. I get why they're making these demands, but this is in the US. This would clearly be an unreasonable search by Fourth Amendment standards if it were done by the government, so I'm not sure why government agencies think they can make dem…

It's also indicative of the unhealthy relationship these giant semi-monopolistic companies have with the government(s), that they implement the government's supposed will out of the fear of anti-trust actions/legislation, without any need for the government to pass legislation. Same goes for the demands to curb "misinformation" of various kinds, which basically constitutes government mandated speech regulation, even though the standing jurisprudence clearly forbids it.

Re: Apple plans to scan US iPhones for child abuse imagery

#229
post #172
post #124

Earlier quoted context omitted.

Don't worry, AI is very good at these things and never makes mistakes. It is so advanced it even understands nuance and complex communication mechanisms like sarcasm in text, even if it's only a single sentence to contrast! It will be able to know exactly the context of each image and it will affect only the sickos. We're also working on watching your face through the camera to see your true expression when viewing t…

There is zero AI classification involved, it’s a lookup vs hashes of known child porn images. You would need a hash collision, misidentified photo in the dataset, or legitimate use case to end up with a false positive.

The article says that Apple calls this system neuralMatch. I'm not sure why that name gives you confidence that there is zero AI involved?
Post reply on HN