Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

41–50 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#41

Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves. Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

> they don't know how to use than the tools themselves. No, the tools work perfectly as they were design to work. The problem is that the tools are flawed. Ultimately, every single of these decisions should be approved by a human, which should be responsible for the fuck up no matter what the consequences are. > _Some_ of the blame lies on the UX here. It must. No, the blame lies with the person or the group who appr…

I miss the days of earlier AI image-recognition software that would emit a confidence percentage.

New LLM-related AIs are all supremely confident in every assertion, no matter how wrong.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#42

This reminds me of the British Post Office Scandal: https://en.wikipedia.org/wiki/British_Post_Office_scandal

I followed the inquiry when it was ongoing — all of the depositions were live on YouTube. The level of both hubris and incompetence involved in that case was breathtaking.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#44
post #27

Earlier quoted context omitted.

Criminal immunity? Sure. Civil immunity? Nope! She could definitely make a nice buck.

Off of taxpayer money sadly. Imo we really need a fix for this. When cops are grossly negligent the money should come out of their aggregate pension fund (or at least partially).

Yes, this is the key point. Tax payers get a nice big bill while the people who caused the problem get a nice paid vacation while they conduct an internal "investigation" that typically finds they did nothing wrong.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#45
post #10

There's no way this isn't a slam dunk case to sue the piss out of the Fargo Police, probably the US Marshals and maybe other orgs. The woman in the surveillance phone clearly looks way younger, among the many other obvious signs this woman didn't do it. I hope she wrings at least several million dollars out of the government.

> I hope she wrings at least several million dollars out of the government. which the citizens end up footing the bill for. yay.

Maybe the citizens will learn to elect better leaders.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#46
post #27

Earlier quoted context omitted.

Criminal immunity? Sure. Civil immunity? Nope! She could definitely make a nice buck.

Off of taxpayer money sadly. Imo we really need a fix for this. When cops are grossly negligent the money should come out of their aggregate pension fund (or at least partially).

There is a fix to it. Elect people who will hold them accountable.

As long as you keep electing clowns that let the police do whatever they want, the police will... Do whatever they want.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#48
Wait - what was the AI tool and how did it have her face to begin with? If small-town police are doing face-matching searches across national databases then nobody is safe because the number of false positives is going to be MASSIVE by sheer number of people being searched every day.

Pretend the tool is 99.999999% specific. If it searches every face in the USA you're still getting about 3 false positives PER SEARCH.

You will never have a criminal AI tool safe enough to apply at a national scale.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#49
post #10

There's no way this isn't a slam dunk case to sue the piss out of the Fargo Police, probably the US Marshals and maybe other orgs. The woman in the surveillance phone clearly looks way younger, among the many other obvious signs this woman didn't do it. I hope she wrings at least several million dollars out of the government.

imho the US Marshals are the only innocent party here, as my understanding is they don't do investigations and just serve warrants without any knowledge of the underlying case.

[deleted]

Re: Innocent woman jailed after being misidentified using AI facial recognition

#50
post #5

AI or not, it's unconscionable that victims of compulsory legal processes by way of mistaken identity are not made whole.

People will defend this, too, saying “well, she was eventually exonerated, right? So the system works!” Ignoring how she’ll never be fully reimbursed for the time, money, and grief of going through the system.
Post reply on HN