Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

311–320 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#311
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

If many people's writing skills are suffering, due to highly convenient AI support, just imagine how fast mediocre crime investigation skills are going to devolve.

It is going to get bad in every skilled area of human managed bureaucracy.

The number of legal filings found to include AI confabulations is just the obvious surface.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#312

Here is the contact information for her defense attorney, who was appointed in North Dakota, Jay Greenwood. It is unclear to me when he took up this case. https://www.ndcourts.gov/lawyers/06020 https://www.linkedin.com/in/jay-greenwood-57360b86/

What did you hope to achieve by posting his details?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#313

Earlier quoted context omitted.

It literally doesn't matter -- you're focused on the wrong thing. She could be that woman's exact twin and it wouldn't matter. Spending six months in jail and losing your house, your car, and your dog with the flimsiest of evidence is ridiculous.

'you can beat the wrap but not the ride' has been a pop culture reference in the US since the 1940s. Our society wants/supports the ability for this to be inflicted at police/court whim on people.

Which means that, if the cops (and other relevant personnel) gets it wrong, they should get served with the same injustices that they committed, no questions asked... you know, because they didn't raise any when they were the ones dishing out punishments.

Edit: wording, formatting

Re: Innocent woman jailed after being misidentified using AI facial recognition

#314
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

It is the fault of the coders, the salespeople who over-promised the capabilities of the system, the lawmakers who have not regulated or demanded a minimum percentage of accuracy from those products, the AI' company's onboarding trainers, the cops that were trained to use the software, the jailers, and maybe other related positions that should've taken a better interest in making a better system, not a more cruel one

Re: Innocent woman jailed after being misidentified using AI facial recognition

#315
post #285
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

I think the biggest problem is that the popular narratives about AI enable this like of accountability sink.

Before AI it was outsourcing. “Not my fault the system is down and we’re losing 1m an hour, AWS is having a bad day”

Re: Innocent woman jailed after being misidentified using AI facial recognition

#316
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

> A live human detective confirmed it.

I doubt it, due to human nature. Perhaps the process says the human must consciously validate, but a lot of humans in many cases will just rubberstamp what the AI said. That's the risk.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#317
post #146
post #46

Earlier quoted context omitted.

There is a fix to it. Elect people who will hold them accountable. As long as you keep electing clowns that let the police do whatever they want, the police will... Do whatever they want.

I'm usually a big supporter of labor unions, but police unions in the US generally have an outsized amount of power, and even when mayors etc. want to hold police accountable, the union ends up bending the mayor over a barrel. I'm not sure what the solution is here. Forbid police from unionizing? That would probably have some bad consequences too.

Malpractice insurance

Re: Innocent woman jailed after being misidentified using AI facial recognition

#318

Earlier quoted context omitted.

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

The “I” in “AI” stands for “intelligence”. Cops are using AI facial recognition because it is being sold to them as being smarter and better than what they are currently capable of. Why are we then surprised that they aren’t second-guessing the technology?

AI facial recognition is smarter than what they are capable of. That's not the issue. It is much faster than a human, and state-of-the-art models make fewer errors than a human (though the types of errors are not the same).

The issue is that facial recognition is just not very reliable. Not for humans and not for machines. If you look at millions of people, some of them just look incredibly similar. Yet police apparently thought that was all the evidence they will ever need. A case so watertight there's no point in even talking to the suspect

Re: Innocent woman jailed after being misidentified using AI facial recognition

#319
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

Because if you let this slide the human, such as he is, will be removed from the loop and these mistakes will become acceptable once departments get used to how cheap the AI is compared to a human. There will be no going back and mistakes like this will just become accepted collateral damage.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#320
post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

Dude, not sure which team are you working in, but across many-many domains - corporate, business and political, people are already delegating full decision making and responsibility to AI. Unless national governments and standards institutions create and enforce ironclad AI governance laws, situations resembling what this poor granny went through are going to occur again, again and again.
Post reply on HN