Live data from Hacker News

Police officer investigated for using AI to 'create evidence' in multiple cases

news.sky.com

41–50 of 210 posts

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#41
post #15

I wonder how many people have been unjustly imprisoned between planted evidence, made up evidence, and illegal parallel construction…

Here in the US? Probably a large double-digit percentage of cases imo…

[dead]

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#42
post #15

Earlier quoted context omitted.

Here in the US? Probably a large double-digit percentage of cases imo…

> large double-digit percentage This is a very very intense claim, and if true, would represent a monumental institutional failure across hundreds or even thousands of disparate organizations. Do you have any data to support your hunch? Strong claims require strong evidence.

When DNA matching was introduced, we discovered that at minimum 10% of people on death row were innocent. Death row cases are among the most litigated and examined cases. So, 10% is a reasonable floor, and we're already in double digits.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#43
post #38

Earlier quoted context omitted.

I worked for a company that made these. We sold expensive software to the FBI. Took about six months for someone to crack the hash.

"Crack the hash"? Does this mean you were employing some novel hashing algorithm and relying on its secrecy? If so your employer were never serious about security in the first place. Hardware attestation is more or less a solved problem, and that solution does not involve secret algorithms.

Eh. It was some kind of hash of the image. I was not involved in that project, so can't tell you exactly how it worked, but the images were "signed," and someone figured out how to "re-sign" an altered image.

I think it was a fairly well-known technique.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#44
post #34

i do wonder, that in the age where we have image and video creation out of the bag, whether or not this will result in whole classes of evidence becoming completely unreliable.

The end-game is that people will willingly surveil themselves 24/7 on behalf of The System because that will be the only way to prove what they didn't do.

Ah yes training the AI with more data to represent me even more accurately.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#45
post #23

i do wonder, that in the age where we have image and video creation out of the bag, whether or not this will result in whole classes of evidence becoming completely unreliable.

You should see what people were capable of in the darkroom, let alone before all this. You could always manipulate imagery ever since there was imagery to manipulate.

This is why:

- the whole roll of negatives was prime evidence;

- police forces were one of the biggest users of Polaroid instant film.

And moreover, who had a darkroom and the skills to edit substantially a picture?

Whereas here we have nobodies being able to generate pixel-perfect fake "evidence" from the computers they already have.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#46

Earlier quoted context omitted.

> large double-digit percentage This is a very very intense claim, and if true, would represent a monumental institutional failure across hundreds or even thousands of disparate organizations. Do you have any data to support your hunch? Strong claims require strong evidence.

When DNA matching was introduced, we discovered that at minimum 10% of people on death row were innocent. Death row cases are among the most litigated and examined cases. So, 10% is a reasonable floor, and we're already in double digits.

> This reasonably sets a floor

I disagree wrt reasonableness. It’s just too big a leap. There are a lot of crimes, and not many land you on death row.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#47
post #23

i do wonder, that in the age where we have image and video creation out of the bag, whether or not this will result in whole classes of evidence becoming completely unreliable.

You should see what people were capable of in the darkroom, let alone before all this. You could always manipulate imagery ever since there was imagery to manipulate.

How many people could do that?

How long did it take?

Now it’s a lot easier and faster

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#48
post #40

Earlier quoted context omitted.

> large double-digit percentage This is a very very intense claim, and if true, would represent a monumental institutional failure across hundreds or even thousands of disparate organizations. Do you have any data to support your hunch? Strong claims require strong evidence.

Police in the United States is already in a state of "institutional failure"...

“Police in the United States” is not a monolith.

It’s easy to say things that sound true on the surface, but even if true, it’s still irresponsible to say them on the back of a hunch.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#49
post #24

I wonder how many people have been unjustly imprisoned between planted evidence, made up evidence, and illegal parallel construction…

Consider all of that can be used for forced confessions and forced plea bargains also. In those cases, the "evidence" doesn't even need to exist at all, or be on the record in any way.

Let alone all it takes is a photo and a voice clip of 10sec to create an imitation of that person confessing to whatever your heart desires.

Re: Police officer investigated for using AI to 'create evidence' in multiple cases

#50
post #15

Earlier quoted context omitted.

Here in the US? Probably a large double-digit percentage of cases imo…

> large double-digit percentage This is a very very intense claim, and if true, would represent a monumental institutional failure across hundreds or even thousands of disparate organizations. Do you have any data to support your hunch? Strong claims require strong evidence.

[deleted]
Post reply on HN