[flagged]
Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
41–50 of 221 posts
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#42Money quote from someone quoted in the article: "[I]t’s not just a technology problem, it’s a technology and people problem." I can't. I just can't.
I've been hearing "it's not just... it's a" touted as an AI sign recently, personally I think it's an AI sign because it's a human thinking shortcut sign, and AI copies it, but it would be funny if AI wrote the article and then hallucinated this specific money quote.
I doubt this happened here, but FWIW, AI does have a habit of "cleaning up" (read: hallucinating) interview transcript quotes if you ask it to go through a transcript and pull quotes. You have to prompt AI very specifically to get it to not "clean up" the quotes when you ask it to do that task.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#43Earlier quoted context omitted.
Yes. But doing the investigation negates much of the incentive for using AI. Look for similar to play out elsewhere --- using unreliable tools for decision making is not a good, responsible business plan. And lawyers are just waiting to press the point.
In this case it sounds as though AI could have been used to generate preliminary leads. When someone calls a tip line with information, police don’t just take their word for it, they investigate it. They know that tips they receive may be incorrect. They should have done the exact same here, but they didn’t. I’m very opposed to AI in general, but this one is clearly human failure. The noteworthy AI angle is the undes…
...but this one is clearly human failure.
Absolutely.
The failure starts with tool vendors who market these statistical/probabilistic pattern searchers as "intelligent". The Fargo police failed to fully evaluate these marketing claims before applying them to their work.
So in the same way that the failure rolled down hill, liability needs to roll back up.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#44Earlier quoted context omitted.
We used to until quite recently. Anybody could buy dynamite at the hardware store. We had to end this because of criminals using it to hurt people.
Except this time the criminals are police.
They are far more often than anyone wants to admit. That's how we got 25% of the world's prison population.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#45Earlier quoted context omitted.
Yes. But doing the investigation negates much of the incentive for using AI. Look for similar to play out elsewhere --- using unreliable tools for decision making is not a good, responsible business plan. And lawyers are just waiting to press the point.
AI can provide leads. Someone still needs to verify them and decide.
Generating and verifying bad leads costs money. Not verifying bad leads can cost much more.
At some point, you have to decide if wasting good money on bad intel makes sense.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#46[flagged]
I would say much more likely that it was because she was poor and couldn't afford a good lawyer.
This, she likely had a shitty public defender that did the bare minimum requirements because they were catering to paying clients. The state was playing hardball because they wanted to make a profit off the poor person with a shitty defense and the public defender was sitting on the bench at a teeball tournament because they werent getting paid enough and didn't want to try.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#47Without even looking at the AI part, I have a single question: Did anybody investigate? That's it. Whether it's AI that flagged her, or a witness who saw her, or her IP address appeared on the logs. Did anybody bothered to ask her "where were you the morning of july 10th between 3 and 4pm. But that's not what happened, they saw the data and said "we got her". But this is the worst part of the story: > And after her o…
I think you missed many important points.
"The trauma, loss of liberty, and reputational damage cannot be easily fixed,” Lipps' lawyers told CNN in an email.
That sounds a LOT like a statement you make for before suing for damages, not to mention they literally say "Her lawyers are exploring civil rights claims but have yet to file a lawsuit, they said."
This lady probably just wants to go back to normal life and get some money for the hell they put her in. She has never been on a airplane before, I doubt she is going to take on the entire system like you suggest. Easier said than done to "challenge the entire system", what does that even mean exactly?
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#48Without even looking at the AI part, I have a single question: Did anybody investigate? That's it. Whether it's AI that flagged her, or a witness who saw her, or her IP address appeared on the logs. Did anybody bothered to ask her "where were you the morning of july 10th between 3 and 4pm. But that's not what happened, they saw the data and said "we got her". But this is the worst part of the story: > And after her o…
I think you missed many important points. "The trauma, loss of liberty, and reputational damage cannot be easily fixed,” Lipps' lawyers told CNN in an email. That sounds a LOT like a statement you make for before suing for damages, not to mention they literally say "Her lawyers are exploring civil rights claims but have yet to file a lawsuit, they said." This lady probably just wants to go back to normal life and get…
It was worse than that, the reporting from an earlier story[0]
...Unable to pay her bills from jail, she lost her home, her car and even her dog.
(Also, what happened to journalism - no Oxford comma?)
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#49This is a weak or misleading story about AI. First, the detective used the FaceSketchID system, which has been around since around 2014. It is not new or uniquely tied to modern AI. Second, the system only suggests possible matches. It is still up to the detective to investigate further and decide whether to pursue charges. And then it is up to court to issue the warrant. The real question is why she was held in jail…
In the US there are no consequences for people in power failing to follow procedures, laws or regulations - except for being told to stop doing whatever illegal thing they're doing, and possibly getting sued way down the line, which gets paid by taxpayers.
From reading more into the case, it seems the issue may be related to how her lawyer handled the case.
They probably did “identity challenge” arguing that she is not the right person. But from Tennessee’s perspective, she was considered the correct person to be arrested, so there was no “mistaken identity” in their system. In other words, North Dakota Wanted person x and here is person x.
Once a judge in North Dakota reviewed the full evidence (and found that person they issued warrant for arrest is not one they want), the case was dismissed.
Re: Police used AI facial recognition to wrongly arrest TN woman for crimes in ND
#50Earlier quoted context omitted.
I've been hearing "it's not just... it's a" touted as an AI sign recently, personally I think it's an AI sign because it's a human thinking shortcut sign, and AI copies it, but it would be funny if AI wrote the article and then hallucinated this specific money quote.
I doubt this happened here, but FWIW, AI does have a habit of "cleaning up" (read: hallucinating) interview transcript quotes if you ask it to go through a transcript and pull quotes. You have to prompt AI very specifically to get it to not "clean up" the quotes when you ask it to do that task.
And why not?
If you look at examples of people quoting on the internet, lots are out of context, paraphrased, or made up.
AI is just mimicking what it has seen.