Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

Post reply on HN
Print view View original

211–220 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#211

Post by pixl97 »

stego-tech wrote: post #130
whack wrote: post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

It's the fault of the tool because our society treats the tools as superior judgements than humans and to be trusted completely as a means of deflecting accountability - something any and every minority group has been warning about for fucking decades . The reason everyone rushes to defend the tool's use is because holding humans accountable would mean throwing these tools out entirely in most cases, due to internal…

>rushes to defend the tool's use is because holding humans accountable would mean throwing these tools out entirely in most cases, due to internal human biases and a decline in basic critical and cognitive thinking skill

The magical past where people had critical thinking skills never existed. We put a lot of trust in tools is because people are unfucking reliable. Hence why in most cases actual physical evidence does a far better job than witness testimony.

This said, people are lazy. It is one of our greatest and worst traits. When we are allowed to be lazy, especially with tools bad things happen.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#212

Post by selcuka »

janalsncm wrote: post #109
Jtsummers wrote: post #3

https://archive.is/yCaVV - Archive link to get around the paywall. https://www.theguardian.com/us-news/2026/mar/12/tennessee-gr... - Another article on this without a paywall. It's annoying that both articles are calling this AI error. This was human error, the police did the wrong thing and the people of Fargo will end up paying for this fuckup.

I would argue it was both. No doubt this company was marketing it in a way to make it seem very reliable. And all of the procedural things afterwards made the error so much more damaging. But imo this is why local police departments should not have access to this kind of tool. It is too powerful, and the statistical interpretation is too complicated for random North Dakota cops to use responsibly. Neither the company…

It's not an AI error. The face recognition AI simply said that it's a "potential match", which is correct. It's the humans' job to confirm that a potential match is in fact a match, especially when the suspect is 1,900 kms away.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#213

Post by FpUser »

abduhl wrote: post #97
mothballed wrote: post #89

Earlier quoted context omitted.

Yeah it's "due process." In civil contempt the judge is a witness and prosecutor in the very "process" they're judging. That's the most perverted form of due process imaginable. A judge should have to recuse themselves if they are acting as witness to the supposed infraction.

Civil contempt isn't some roving criminal charge that jumps out of the jury box randomly. It's meant to make somebody comply with a court order. Anybody in civil contempt holds the keys to the jailhouse door in their own hands, all they have to do is comply. This statement should make you uncomfortable. It makes me uncomfortable because it is a pure expression of the power of the state. But it's still due process.

In Criminal Contempt max duration of imprisonment is limited. In civil it is not until somebody decides that one never complies. You may call it due process. I call it for what it is - A torture and fucking crime against humanity. Judge that holds person for years for being stubborn deserves nothing more than walk the plank

Re: Innocent woman jailed after being misidentified using AI facial recognition

#214

Post by ihsw »

selcuka wrote: post #203
wvenable wrote: post #136

Earlier quoted context omitted.

I disagree. The city or state gets sued and they pay the result from the taxpayer funds and literally nobody learns anything, especially not the hard way. Everyone is so completely divorced, and in some cases immune, from consequences that this will change nothing.

After a couple million dollar lawsuits the city or state will learn to be more careful with their methods. It's the taxpayer funds, but it's not an endless supply of money. Cities and states have their own budgets.

[dead]

Re: Innocent woman jailed after being misidentified using AI facial recognition

#215

Post by mlinsey »

malwrar wrote: post #190
pj_mukh wrote: post #119

Earlier quoted context omitted.

I'm sorry but this is a piss-poor excuse. When I Claude code broken features, I'm responsible 100%. Why are cops not treated the same way? OP is right, AI is totally irrelevant in this story. If the point is "cops can't be trusted". Why do they have GUNS?! AI is the least of your problems. I feel like I'm going crazy with this narrative.

You are right IMO to question why North Dakota police were able to obtain this Tennessean woman in the first place, you’d think something like that should require far more sufficient evidence than facial recognition. But, then what good is facial recognition for? Would it have been okay for this woman’s life to have been merely invaded because she matched a facial recognition system? Maybe they can just secretly watc…

Having a facial recognition match make you a suspect and cause the police to ask you some questions doesn't seem completely unreasonable to me. Investigations can certainly begin with weak forms of evidence (like an anonymous tip), you just require a higher standard of evidence for a search warrant, surveillance, or an arrest. A facial recognition match shouldn't be probable cause for an arrest warrant, but it still might be a useful starting point for a detective looking for actual evidence.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#216

Post by samrus »

Theres alot of talk about how the cops just misused the tool and its their fault not the AIs

Thats missing the point here. The point is that these tools provide crazy leverage, and thay can be good or bad. If used carefully it can definitely catch criminals faster, but when misused (or abused) they can let the authorities unjustly ruin lives faster

The question isnt whether AI is perfect or not. Its whether you trust the authorities with it. To use and abuse as they can. Think about the average cop. Think about the way Trump treats people. Think about the way israel keeps an ongoing genocide going. Think about the cases of police brutality that happen in the US, the cases of racial profiling. Think about ICE and their behavior, going around kidnapping and killing people. Do you want these people to have more leverage?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#217

Post by [deleted] »

whack wrote: post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

[deleted]

Re: Innocent woman jailed after being misidentified using AI facial recognition

#218

Post by tomhow »

zoklet-enjoyer wrote: post #180

I posted this 9 hours ago. Can I get the karma transferred to my account?

As much as we try to reward the first person to submit the story, we also have to give credit to the person who submits the best URL and the best version of the story. It looks like your submission was killed due to being an archive.is link, which is not allowed as a URL for a submission (we need the canonical URL submitted to prevent people from using archive services or shorteners to mask domains that may be malicious).

Sometimes it's just a matter of luck as to who gets the submission right and gets the karma. Sorry it wasn't you this time, but keep submitting good stuff and you'll get your turn.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#219

Post by spicymaki »

How many more articles are we going to see with the headline AI facial recognition leads to innocent person jailed? A grandmother no less.

Some tech company illegally scanned people's photos on social media and now is using them with our complicit legal system to randomly put people behind bars. Now I need to worry that any day now due to a dice roll I will be sent away in a the middle of f'ing nowhere for months or years. Now the government wants to use these same dumb systems to make automated killing machines. FML!

I see a lot of comments trying to attribute blame to the cops, the lawyers, the police chief, the marshals, the tech bros, etc, but it is all of them and all of us that are guilty. We are so complicit in this sick system we live in. We are stuck in a collective action deadlock.

That fear you have in the back of your mind that says next time it might be you is counteracted by the thought "well thank goodness it wasn't me or a loved one," so you don't act. We are all doing this, that is why nothing changes.

The only people able to act these days are the most insane. The narcissistic corrupt power hungry politician, the psychopathic tech bro billionaire, and the jacobins are the only ones with the energy wade through this cesspool and that is why everything is so dystopian.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#220

Post by zoklet-enjoyer »

tomhow wrote: post #218
zoklet-enjoyer wrote: post #180

I posted this 9 hours ago. Can I get the karma transferred to my account?

As much as we try to reward the first person to submit the story, we also have to give credit to the person who submits the best URL and the best version of the story. It looks like your submission was killed due to being an archive.is link, which is not allowed as a URL for a submission (we need the canonical URL submitted to prevent people from using archive services or shorteners to mask domains that may be malici…

I don't like the local newspaper and posted the archive link so they wouldn't get the clicks. I didn't know that wasn't allowed. Thanks for the info
Post reply on HN