Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Gets Wrong Woman Jailed for Six Months, Life Ruined

youtube.com

Post reply on HN
Print view View original

21–29 of 29 posts

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#21

Post by OutOfHere »

Those deploying AI where it can affect individuals must ensure that the UI always prominently shows the failure rate.

For example, if a person's face is matched to a ID, the UI must show not just the match percentage (which is very misleading) but also contextually the odds of getting it wrong. For example, if there are 7 IDs whose face is at least a 95% feature match to the thief, the odds of getting it wrong are at least 6 out of 7, meaning the chances of an accurate classification is just 14% at best!

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#22

Post by throwaway439080 »

bradley13 wrote: post #3

Really, it's more about the police not doing their job. Face recognition pointed her out, the police saw she had a rap sheet, and therefore they didn't check further. She apparently could not afford a lawyer, who would have pointed out that she was provably at home (transactions, etc.) at the time the crime was committed in another state. Really it's not specifically AIs fault, though it made the error easier.

Yes and no. I think the interesting thing about this story is how it's been presented: AI as a scapegoat for incompetence.

The police made an inexcusable mistake out of carelessness. They simply couldn't be bothered to spend five minutes fact-checking the facial recognition match, and it caused catastrophic harm to an innocent woman.

And what's the headline? "AI did this". It's a new and exciting way for people to shirk accountability for their actions. We're already seeing it in the reporting on the Iranian school bombed by the United States: blame AI for selecting the target, and not the humans in the loop who failed to do the most basic due diligence.

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#24

Post by alcomatt »

mft_ wrote: post #10
santoshalper wrote: post #5

Earlier quoted context omitted.

I still wouldn't let AI off the hook here. Every link in the chain has to be accountable for fuckups. You don't get to pass it along to the supposed "human in the loop" when you fail spectacularly. That's how we end up with shitty "almost works" AI.

Sure, the AI contributed, but it was far less responsible overall than the humans in this case. Don't let the AI system off the hook by all means, but by focusing on it to this extent, the narrative ignores (deliberately?) the hugely negligent actions of the police et al involved.

AI or more precisely the way it is being sold to us is the most responsible factor here. People by nature are lazy and will take shortcuts given an opportunity. AI is the ultimate shortcut these days, a "mental crutch" majority of the people using it are leaning on. Humans just did what they always do, be lazy - AI should never have been used for processes with this level of life-altering impact because what happened here was bound to happen.

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#25

Post by mulosolitario »

AI gets wrong 40%,50% even 70% of the times. Nonetheless Anthropic Claude has been used (behind Palantir) by the most moral army in the world to decide who to kill in Gaza or where to drop the bombs in Teheran. AI "solves" the problem of the accountability because it can fabricate all the "legitimate targets" you need. So now you can drop a bomb and kill 10 children and claim it is moral because AI said they are terrorists.

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#26

Post by Hizonner »

alcomatt wrote: post #24
mft_ wrote: post #10

Earlier quoted context omitted.

Sure, the AI contributed, but it was far less responsible overall than the humans in this case. Don't let the AI system off the hook by all means, but by focusing on it to this extent, the narrative ignores (deliberately?) the hugely negligent actions of the police et al involved.

AI or more precisely the way it is being sold to us is the most responsible factor here. People by nature are lazy and will take shortcuts given an opportunity. AI is the ultimate shortcut these days, a "mental crutch" majority of the people using it are leaning on. Humans just did what they always do, be lazy - AI should never have been used for processes with this level of life-altering impact because what happened…

Nobody's "selling it" as more reliable than it is. People are assuming it's more reliable than it is.

> People by nature are lazy and will take shortcuts given an opportunity.

So, um, the fact that humans are behaving incompetently means we should shift the responsibility onto a machine?

Suppose a human had looked at some crappy surveillance video from hundreds of miles away, and told the primary investigator "that looks like it could be her; you might want to check it out". Would that human be the most responsible person in the chain? The moron who took that as gospel and actually made an arrest has no agency at all here?

Come on, a facial recognition match? Facial recognition probably shouldn't be used because it's bad when it works, but everybody with a functioning synapse knows that facial recognition is going to get lots of false hits.

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#27

Post by tim333 »

bradley13 wrote: post #3

Really, it's more about the police not doing their job. Face recognition pointed her out, the police saw she had a rap sheet, and therefore they didn't check further. She apparently could not afford a lawyer, who would have pointed out that she was provably at home (transactions, etc.) at the time the crime was committed in another state. Really it's not specifically AIs fault, though it made the error easier.

They don't even look that identical - the fraudster on cctv appears about a decade younger than Angela Lipps.

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#28

Post by [deleted] »

throwaway439080 wrote: post #22
bradley13 wrote: post #3

Really, it's more about the police not doing their job. Face recognition pointed her out, the police saw she had a rap sheet, and therefore they didn't check further. She apparently could not afford a lawyer, who would have pointed out that she was provably at home (transactions, etc.) at the time the crime was committed in another state. Really it's not specifically AIs fault, though it made the error easier.

Yes and no. I think the interesting thing about this story is how it's been presented: AI as a scapegoat for incompetence. The police made an inexcusable mistake out of carelessness. They simply couldn't be bothered to spend five minutes fact-checking the facial recognition match, and it caused catastrophic harm to an innocent woman. And what's the headline? "AI did this". It's a new and exciting way for people to sh…

[deleted]

Re: AI Gets Wrong Woman Jailed for Six Months, Life Ruined

#29

Post by pseudohadamard »

DoktorDelta wrote: post #9
mft_ wrote: post #6

Earlier quoted context omitted.

Quite; AI contributed to a (criminally?) inept and negligent "justice" system ruining an innocent woman's life. The AI was akin to an unreliable eye-witness in this case, although people's trust in the AI's judgement may have been higher than a human eyewitness?

Absolutely, this is what is going to happen when the average person gets to use AI- "well, the computer says..."

... "no", https://www.youtube.com/watch?v=x0YGZPycMEU.
Post reply on HN