Live data from Hacker News

Hash collision in Apple NeuralHash model

github.com

681–690 of 725 posts

Re: Hash collision in Apple NeuralHash model

#681

Earlier quoted context omitted.

Yes I'm aware that it checks against a known database but clearly there can be collisions. So eventually it will share someone's private images.

It would need to have 30 collisions before anything even took place, which realistically isn't going to happen.

Most cameras nowadays can easily take a burst of 30 visually very similar images in a second.

Lots of people leave their cameras in burst mode.

Re: Hash collision in Apple NeuralHash model

#682
post #11

Earlier quoted context omitted.

Are you pinning your hopes that a false positive like this will be appropriately caught because of an army of faceless, low wage workers who stare at CSAM cases all day will immediately flag?

Apple has pretty deep pockets. Think how much that judgement is going to be when they find themselves in court for letting someone get raided over gray images. Not that it's going to happen, since it would also require NCMEC to think the images match, but whatever. Attack me! Attack me! I want to retire.

> Apple has pretty deep pockets.

For now, sure. What happens when their money runs short? What about the other tech companies that will inevitably be forced to deploy this shit? Will they also have Apple's pretty deep pockets?

Blind faith in this system will not magically fix how flawed it is nor the abuse and harm it will allow. This is going to hurt a lot of innocent people.

Re: Hash collision in Apple NeuralHash model

#683

Earlier quoted context omitted.

The police do not show up until a human has compared the matched image to the actual. Just stop.

The more collisions, the more chances of a false positive by a (tired, underpaid) human. I don't envy the innocent person whose home gets raided by a SWAT team convinced they're busting a child sex trafficker.

The database is known to contain non-csam images like porn. I doubt the reviewer will be qualified to discern which is which.

Re: Hash collision in Apple NeuralHash model

#684
post #52

Earlier quoted context omitted.

All criminal accusations, including true ones , should be treated as false until the accused is proven guilty. This is a fundamental tenet of human rights in western, small-l liberal free societies. The fact that this is controversial these days is literally insane to me. The consequences of throwing this fundamental system out the window is that you get the sort of nonsense that happened with Assange, where he was l…

> All criminal accusations, including true ones, should be treated as false until the accused is proven guilty. No, they need to be treated as unproven, a very critical difference. Just to be clear, witness testimony, including testimony FROM THE VICTIM, is evidence of the crime. Just for some reason, in rape cases, we go all wonky with this principle.

All criminal accusations need to be treated as unproven, of course, could not agree more. Also, all those accused of a crime (and those not!) need to be treated as innocent until they are proven guilty.

Re: Hash collision in Apple NeuralHash model

#685
post #149

Earlier quoted context omitted.

> All criminal accusations, including true ones, should be treated as false until the accused is proven guilty. No, they need to be treated as unproven, a very critical difference. Just to be clear, witness testimony, including testimony FROM THE VICTIM, is evidence of the crime. Just for some reason, in rape cases, we go all wonky with this principle.

1. By the public at large it should not be treated in any regard, false or not. 2. The state is the only authorized monopoly of violence and they should treat unproven and untrue as identical, and the only place where that decision is made is in a courtroom. 3. The 'believe the victims' activists however are rightfully (IMHO) suggesting to break principle #2 because there is institutional and systemic supression of t…

The legal system may have problems but that is about implementation, the fundamental principles of presumption of innocence, that no harm should come to the innocent, that all are equal before the law, and that truth comes before all other concerns; these are fine principles and I would say that problems with the legal system mostly stem from straying from these principles. Perhaps you disagree?

Re: Hash collision in Apple NeuralHash model

#686
post #680
post #391

Earlier quoted context omitted.

This isn’t true at all. If the creation of fakes is as easy as claimed, Neuralhash evidence alone will become inadmissible. There are plenty of lawyers and money waiting to establish this.

> This isn’t true at all. > If the creation of fakes is as easy as claimed, Neuralhash evidence alone will become inadmissible. Okay. https://github.com/anishathalye/neural-hash-collider

Uh? So his if statement is true?

Re: Hash collision in Apple NeuralHash model

#687
post #686
post #680

Earlier quoted context omitted.

> This isn’t true at all. > If the creation of fakes is as easy as claimed, Neuralhash evidence alone will become inadmissible. Okay. https://github.com/anishathalye/neural-hash-collider

Uh? So his if statement is true?

Please read what is written right before that... You are taking something out of context.

Re: Hash collision in Apple NeuralHash model

#688
post #492

Earlier quoted context omitted.

You are aware that a lot of CSAM are close ups of say pussies for example, and human anatomy can look very similar? I'm not talking about images of rape here. I'm taking about images that you'd see on a regular porn site, of adults and their body parts. You are also aware that CSAM covers anywhere from 0 to 17.99 years of age, and the legal obligation to report exists equally for the whole spectrum? So let's say I do…

> You are aware that a lot of CSAM are close ups of say pussies for example, and human anatomy can look very similar? I doubt images that look quite generic will make it into those hash sets, though.

What is the factual basis for you to doubt that?

Re: Hash collision in Apple NeuralHash model

#689
post #11

Earlier quoted context omitted.

Are you pinning your hopes that a false positive like this will be appropriately caught because of an army of faceless, low wage workers who stare at CSAM cases all day will immediately flag?

Apple has pretty deep pockets. Think how much that judgement is going to be when they find themselves in court for letting someone get raided over gray images. Not that it's going to happen, since it would also require NCMEC to think the images match, but whatever. Attack me! Attack me! I want to retire.

>Attack me! Attack me! I want to retire.

If you post your whatsapp address, I'm sure someone will oblige.

Re: Hash collision in Apple NeuralHash model

#690

Earlier quoted context omitted.

Because the hashes are stored on the user's device?

No, encrypted and blinded hashes are stored. You can’t extract them.

Right, but your device is checking against the hashes, no?

So at some point you generate an image which triggers a subroutine and you know that image collides.

Post reply on HN