Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

321–330 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#321

Earlier quoted context omitted.

Someone from the government should be in jail for this kind of oversight.

I think the taxpayers owe this lady at least a couple million if not more for the inconvenience they chose to put her through.

That shouldn't be taxpayers. That should come from the malpractice insurance, similarly how doctors pay.

After a while, when premiums shoot up, they'd start to behave

Re: Innocent woman jailed after being misidentified using AI facial recognition

#322
post #86
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

not the first instance.

This was 2023 https://www.youtube.com/watch?v=lPUBXN2Fd_E&t=19s

A dude in the usa was arrested in a casino by police because the casino's facial recognition software said he had been trespassed before. He hadn't. I think there was height differences and eye colour difference. The police still arrested him, booked him. I think the prosecutors took it to trial.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#323
post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

I feel like I'm going crazy that anyone tries to suggest the AI and the producers and promulgators and apologists of AI played no part and bear none of the responsibility in this narrative.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#324
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

[deleted]

Re: Innocent woman jailed after being misidentified using AI facial recognition

#325
There are many cases of harm caused by ML false positives.

There are also some cases of law enforcement successes caused by ML true positives, e.g. a RAF (Red Army Faction - https://en.wikipedia.org/wiki/Red_Army_Faction) terrorist gone into hiding was identified by a social media photo: https://web.archive.org/web/20240305044603/https://www.nytim... (although the success in law enforcement was actually not carried out by the police, but by investigative journalists/podcasters.)

The question we need to answer as a society is if we are willing to tolerate any innocent people to go to jail as the "price" of catching a few more criminals.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#326

Earlier quoted context omitted.

I haven't lived there in years, nor do I have exact numbers, but they make national news enough for the same problem nearly every year. I'll drop you some links if you care. 1 - 38 million between 2017 and 2022. 2 - 29 million in 2023. 3 - 12 million in settlements in 2025. Dare I keep going? [1] https://www.wdrb.com/in-depth/louisville-payouts-for-police-... [2] https://www.aol.com/louisville-paid-least-29m-settle-1…

The region's GDP is 100 billion dollars, so these are tiny amounts, although they may seem large to some. And the first article you link proves that people are already worried about it. You think they can safely 10x that?

LMPD budget is $250m, if they lost ~10% of it every year, they'd surely notice.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#327
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

> How is this the fault of AI? The false positive rate combined with scanning millions of pictures might make the chance of arresting the wrong person really high.

The wrong detection is the AI's fault. Anything after and based off that is the fault of humans.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#328

Earlier quoted context omitted.

The “I” in “AI” stands for “intelligence”. Cops are using AI facial recognition because it is being sold to them as being smarter and better than what they are currently capable of. Why are we then surprised that they aren’t second-guessing the technology?

AI facial recognition is smarter than what they are capable of. That's not the issue. It is much faster than a human, and state-of-the-art models make fewer errors than a human (though the types of errors are not the same). The issue is that facial recognition is just not very reliable. Not for humans and not for machines. If you look at millions of people, some of them just look incredibly similar. Yet police appare…

So the sane solution here is just leaving unreliable stuff to humans and reliable to machines. Especially so when human wellbeing and freedom are at the stake.

To define the line between the two, calculate the percentage of cases when mainstream CPUs return anything but integer 4 after addition of integer 2 and integer 2, and use that as the threshold to define "reliable".

Re: Innocent woman jailed after being misidentified using AI facial recognition

#329

Earlier quoted context omitted.

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

Dude, not sure which team are you working in, but across many-many domains - corporate, business and political, people are already delegating full decision making and responsibility to AI. Unless national governments and standards institutions create and enforce ironclad AI governance laws, situations resembling what this poor granny went through are going to occur again, again and again.

There’s money to be made selling AI plausible deniability machines that allow end users to enact unethical policies while evading accountability, but only if all moral responsibility ostensibly falls on the end user and none on the dealer.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#330

Earlier quoted context omitted.

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

I feel like I'm going crazy that anyone tries to suggest the AI and the producers and promulgators and apologists of AI played no part and bear none of the responsibility in this narrative.

Because the responsibility lies on the part of the criminal justice system who used the flimsy AI facial recognition evidence to arrest and hold her for months. If AI didn't exist, and this same incident happened because a human looked at a photograph of the woman and said "I think this might be the same person who committed the crime in the video", it would be insane to blame the people who invented photographs or video recording for her arrest.
Post reply on HN