Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

Post reply on HN
Print view View original

181–190 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#181

Post by heavyset_go »

pj_mukh wrote: post #119
rglover wrote: post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

When you foster a culture of impunity and passing the buck, don't be surprised when they pass the buck to the inscrutable black box they bought.

You might even argue that's the purpose of the inscrutable black box.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#182

Post by worik »

whack wrote: post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

> How is this the fault of AI?

It is not. It is the fault of the police

AI models are tools. When mistakes are made they are the mistake of the operator of said tool

This AI model was badly misused, this woman should get a metric shit tonne of compensation, but it was the fault of the police.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#183

Post by worik »

foxglacier wrote: post #179
rglover wrote: post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

So what? There were false arrests and convictions made by misuse of line-ups, DNA, eye-witnesses, photos, bloodstains, fingerprints, etc. since forever. You must also blame all those other technologies, so what do you think the police should use to find suspects? In your view, the more help police have, the worse a job they'll do. Is that actually the trend?

So what???

This woman lost most of her material possessions, was terrorised by "goons"... The police do this stuff regularly, as black people, immigrants, "white trash" etcetera know well. Another opportunity, presented BY AI models for more routine police oppression

As the wise singer said: "Fuck the police!"

Re: Innocent woman jailed after being misidentified using AI facial recognition

#184

Post by jldugger »

Pxtl wrote: post #36
jchama wrote: post #19

The movie "Brazil" was right!

Except in "Brazil" it was a mechanical error in a deterministic machine caused by an invasive outside actor. It would be reasonable to trust that the autotypewriter/printer would faithfully output the correct text. Modern AI seems incapable of any respectable amount of accuracy or precision. Trusting that to destroy somebody's life is even more farcical than the oppressive police in "Brazil".

>Except in "Brazil" it was a mechanical error in a deterministic machine caused by an invasive outside actor.

It was a literal bug in the computer. Metaphor as humor!

Re: Innocent woman jailed after being misidentified using AI facial recognition

#185

Post by foxglacier »

worik wrote: post #183
foxglacier wrote: post #179

Earlier quoted context omitted.

So what? There were false arrests and convictions made by misuse of line-ups, DNA, eye-witnesses, photos, bloodstains, fingerprints, etc. since forever. You must also blame all those other technologies, so what do you think the police should use to find suspects? In your view, the more help police have, the worse a job they'll do. Is that actually the trend?

So what??? This woman lost most of her material possessions, was terrorised by "goons"... The police do this stuff regularly, as black people, immigrants, "white trash" etcetera know well. Another opportunity, presented BY AI models for more routine police oppression As the wise singer said: "Fuck the police!"

Exactly, it's the police's fault, as well as the wider system they operate in that enables that kind of abuse, and they do it anyway even with out AI.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#186

Post by culi »

whack wrote: post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

Study after study has shown a very strong and consistent bias of humans to trust "automated systems" in face of any ambiguity

Re: Innocent woman jailed after being misidentified using AI facial recognition

#187

Post by lokar »

whack wrote: post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

Automation has a strong tendency to degrade diligence.

I see this all the time in operational / production settings. Having a loop with automation reviewed and approved by a human degrades very fast. I only approve automation that has a quick path to unsupervised operation.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#189

Post by catlikesshrimp »

foxglacier wrote: post #179
rglover wrote: post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

So what? There were false arrests and convictions made by misuse of line-ups, DNA, eye-witnesses, photos, bloodstains, fingerprints, etc. since forever. You must also blame all those other technologies, so what do you think the police should use to find suspects? In your view, the more help police have, the worse a job they'll do. Is that actually the trend?

With all other proof you mentioned, there was always a human putting his signature.

Now that they can blame "AI" no specific officer(s) will take the blame, ever. If no one is responsible there will be many more false positives.

And false positives destroy lives

Re: Innocent woman jailed after being misidentified using AI facial recognition

#190

Post by malwrar »

pj_mukh wrote: post #119
rglover wrote: post #86

Earlier quoted context omitted.

> How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. Because we're seeing the first instances of what reality looks like with AI in the hands of the average bear. Just like the excuse was "but the computer said it was correct," now we're just shifting to "but the AI said it was correct." Don't underestimate how much authority and thinking people will delegate to machines. N…

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

You are right IMO to question why North Dakota police were able to obtain this Tennessean woman in the first place, you’d think something like that should require far more sufficient evidence than facial recognition.

But, then what good is facial recognition for? Would it have been okay for this woman’s life to have been merely invaded because she matched a facial recognition system? Maybe they can just secretly watch you so you’re not consciously aware of being investigated? Should that be our new standard, if a computer thinks you look like a suspect you can be harassed by police in a state you’ve never even been in?

I just don’t see a legitimate way for AI to empower officers here without risking these new harms. That’s why I lean towards blaming the AI tech, rather than historically intractable problems like the reality of law enforcement.

Post reply on HN