Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

221–230 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#221

Earlier quoted context omitted.

That’s really horrible. I’d prefer to know rather than guess at that.

It's pretty common when a dog is abandoned. Likely her children couldn't afford to care for it. I suppose there is a chance they put it up for adoption (same outcome is likely).

Sorry. I really fucking hate this. I don’t imagine there is a charity somewhere that works against this?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#222
post #51

> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color. > Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been i…

> How is this the fault of AI?

AI is being used by bureaucrats and enforcers to justify lazy, harmful conclusions. You don't live in the real world if you think "just punish the bureaucrats, don't make it about AI" is going to remotely rectify this toxic feedback loop and ecosystem.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#223
post #39

Earlier quoted context omitted.

This x1000. We need to suspend this shared fiction that AI has any agency. Only humans can be responsible. Full stop.

[flagged]

This question doesn't even make sense. Why wouldn't humans still be the ones responsible? Bot account?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#224
post #207

Earlier quoted context omitted.

Because they are supposed to possess minimum levels of intelligence found in homo sapiens, which includes not believing anything a salesperson says. Also, their whole job is dealing with people who constantly lie to them.

There are two things occurring here. Police get raises and recognition for closing cases. In general they don't care if you're guilty or not, that's someone else's problem. Same with the detective, same with the DA. The more cases they close they 'tougher they are on crime'. The next thing occurring is https://en.wikipedia.org/wiki/Computer_says_no https://en.wikipedia.org/wiki/Computer_says_no

Similarly: https://en.wikipedia.org/wiki/Automation_bias

Re: Innocent woman jailed after being misidentified using AI facial recognition

#225
post #218

Earlier quoted context omitted.

As much as we try to reward the first person to submit the story, we also have to give credit to the person who submits the best URL and the best version of the story. It looks like your submission was killed due to being an archive.is link, which is not allowed as a URL for a submission (we need the canonical URL submitted to prevent people from using archive services or shorteners to mask domains that may be malici…

I don't like the local newspaper and posted the archive link so they wouldn't get the clicks. I didn't know that wasn't allowed. Thanks for the info

Yep, totally understand. It takes a lot of trial and error to know all the ways of HN.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#226

I really, really need folks to understand that deflecting blame away from the tool and trying to hold the human accountable feeds right into the marketing playbook of these companies in the first place. The cops cannot be held accountable because the laws basically give them immunity. The politicians cannot be held accountable beyond being tossed out at the next election, because the laws otherwise give them immunity…

I disagree. If you focus on holding the software creators to account in lieu of the humans in the loop, the we only reinforce the behavior of offloading thinking to the system.

If I am a cop in another jurisdiction and I see that in this case of error, the facial recognition company was held to account but not the police or municipality, I will be more likely to blindly trust the software assuming that they either patched it or will take responsibility.

We should demand accountability for both.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#227

I really, really need folks to understand that deflecting blame away from the tool and trying to hold the human accountable feeds right into the marketing playbook of these companies in the first place. The cops cannot be held accountable because the laws basically give them immunity. The politicians cannot be held accountable beyond being tossed out at the next election, because the laws otherwise give them immunity…

>Start holding capital to account

You forgot one: capital cannot be held accountable for making a tool used in a crime. It is a simple generalization of the Protection of Lawful Commerce in Arms Act (PLCAA), passed in 2005, which largely bars civil lawsuits against gun makers and sellers when their products are later used in crime.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#229

Earlier quoted context omitted.

You are right IMO to question why North Dakota police were able to obtain this Tennessean woman in the first place, you’d think something like that should require far more sufficient evidence than facial recognition. But, then what good is facial recognition for? Would it have been okay for this woman’s life to have been merely invaded because she matched a facial recognition system? Maybe they can just secretly watc…

Having a facial recognition match make you a suspect and cause the police to ask you some questions doesn't seem completely unreasonable to me. Investigations can certainly begin with weak forms of evidence (like an anonymous tip), you just require a higher standard of evidence for a search warrant, surveillance, or an arrest. A facial recognition match shouldn't be probable cause for an arrest warrant, but it still…

It is absolutely not reasonable to use low-quality photos to decide someone halfway across the country with no history of even leaving their local area is 'a suspect'.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#230
post #56

It's not an AI error. It's a human error in mis-using AI in this way. Saying it's an AI error is like saying a hole in your drywall is a hammer error. Unfortunately we'll probably see a trend of people using AI and then blaming AI for cases where they mis-used AI in roles it's not good for or failed to review or monitor the AI.

We should probably stop telling the cops that this hammer is great for drywall.
Post reply on HN