Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

351–360 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#351

Earlier quoted context omitted.

If it didn't erase accountability, how would it create any value? Many people are treating this as a matter of philosophy, which it isn't. At a primitive, physiological level if you delegate to AI and most of the time you don't get in trouble for it, the resulting relationship you have with the AI could only be called "trust". If you're expected to be 40% more productive at your job, your employer is making it crysta…

The value is creates is obvious: finding a needle in a haystack. Is accountability laundering another potential benefit? Sure. Can we stop pretending we don't understand understand the other side of it? Cynicism is nice and all but after a certain point it eventually wraps around and makes us look naive.

Unlimited power, no accountability, and no morals or consequences.

It surely sounds like a recipe for pure evil.

This AI committed an imprisonable offense against society, an act of criminal negligence born of pure sociopathy. Throw the clanker in the clink.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#352
> She had already been in jail for more than five months. It was the first time police interviewed her.

Hang on -- ignoring AI completely, how is that possible / legal / anything? Surely, if she was misidentified, there was an interview and arrest and due process?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#353

Earlier quoted context omitted.

It's only recently some have come to terms with the fact that DNA evidence sometimes returns false positives. Society, and law enforcement, assumed that DNA was infallible. No one apparently wondered millions of people could be reduced to a tiny number of genetic markers apparently having no overlap. Danish police had to redo 20.000 DNA tests with a larger set of markeres begin tested, because they jailed someone bas…

There was a man arrested in Santa Clara county because his DNA was tracked to a murder scene by the paramedics that treated him before they were called to the scene of the murder. He only got away with it because the public defender realized that he was in the hospitals detox at the time of the murder.

Typically, the “it” in the phrase “got away with it” refers to an action that broke the rules.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#354
post #337

This has nothing to do with AI. There are also a few questions that remain unanswered: - Did she have previous arrests, and did they use booking photos to identify her? I found someone named Angela Lipps who was arrested in 2001, 2003, 2017, and 2019. The 2017 arrest was for a probation violation: https://archive.ph/CpmXu The 2019 arrest was for public intoxication: https://archive.ph/yjFL9 - Another confusing detail…

Appealing to authority ("The AI said it was her!") is absolutely a problem.

No. I think the core issue is that they used her 2019 booking photo (a mugshot) from a public intoxication arrest. I am not sure whether a photo like that is reliable :)

In the end, the detective compared the booking photo with the camera footage and concluded they were the same person, then presented that to the judge.

I also wonder what her “probation” was for. Maybe she once wrote a bad check and got into trouble, which might have made the detective more inclined to believe it was her.

Anyway, this does not appear to be an AI issue at all.

But it is nice scary story to remind us not to be lazy and trust it unconditionally.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#355

Earlier quoted context omitted.

What do you propose we do in the latter situation? The news isn't the value of the life that was (presumably lost). The news is the circumstances that made that loss possible. Human driver was maybe careless, or maybe didn't look. The child safety classes I took emphasized over and over again to look around your car and yard before backing your car out. This is a problem with a known solution that unfortunately still…

"This is a problem with a known solution that unfortunately still happens despite the best efforts to prevent it." Great, let's just apply that logic to Waymo as well and call it a day (see how silly that sounds?). Waymo has engineers..so does the Department of transportation.

I'm really not sure how to respond to this because it seems like you're insinuating that the Dept of Transportation has the same level of control over ALL cars in the country as Waymo has over their cars.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#356

Earlier quoted context omitted.

I feel like I'm going crazy that anyone tries to suggest the AI and the producers and promulgators and apologists of AI played no part and bear none of the responsibility in this narrative.

Because the responsibility lies on the part of the criminal justice system who used the flimsy AI facial recognition evidence to arrest and hold her for months. If AI didn't exist, and this same incident happened because a human looked at a photograph of the woman and said "I think this might be the same person who committed the crime in the video", it would be insane to blame the people who invented photographs or v…

The problem is in how these tools are sold to them. Not everybody can be an expert in every topic. Like in every other application area, these AI systems are promoted as being able to do about a thousand times more, and a million times more reliably, than they actually are. Of course the departments can be expected to do some due diligence and instruct their officers, but the lies by AI system suppliers is where a large part of the blame belongs. Manufacturers of cameras or CCTV systems never told the police department that the system would do their job for them.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#357

I really, really need folks to understand that deflecting blame away from the tool and trying to hold the human accountable feeds right into the marketing playbook of these companies in the first place. The cops cannot be held accountable because the laws basically give them immunity. The politicians cannot be held accountable beyond being tossed out at the next election, because the laws otherwise give them immunity…

Is there anything to suggest this sort of injustice isn't happening in low-tech all the time, constantly, all over the country, and the only reason it's getting attention here is because AI is involved?

The scale is not the same. Low-tech tools require more human input, more pre-filtering of suspects. They can't just default to starting with "everybody" and match against millions at the push of a button.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#358

Earlier quoted context omitted.

The region's GDP is 100 billion dollars, so these are tiny amounts, although they may seem large to some. And the first article you link proves that people are already worried about it. You think they can safely 10x that?

> The region's GDP is 100 billion dollars, so these are tiny amounts, although they may seem large to some. It's a fair point and easy to handwave away "it's only $100 per resident." But it's a lot of money still. And yet that city is shutting down schools and selling off school properties to make budget this year. I bet they'd love to have those wasted millions. > You think they can safely 10x that? I have no idea t…

> I have no idea the reason for this question

Well it does make sense, in the full context of the thread. I'll let future readers decide.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#359
post #213

Earlier quoted context omitted.

In Criminal Contempt max duration of imprisonment is limited. In civil it is not until somebody decides that one never complies. You may call it due process. I call it for what it is - A torture and fucking crime against humanity. Judge that holds person for years for being stubborn deserves nothing more than walk the plank

Any power that could force a judge to actually walk the plank for what they see as an abuse of power, is itself something like a state, that could just as easily wield that power against the stubborn defendant.

Judges are not above the law. They could be and are being made to "walk a plank". Problem is that we have many laws that are very shitty and allow abuse and are heavily distorted to benefit anyone but "we the people"

Re: Innocent woman jailed after being misidentified using AI facial recognition

#360
post #2

> facial recognition showed she was the main suspect in what Fargo police called an organized bank fraud case. > Her bank records showed she was more than 1,200 miles away, at home in Tennessee at the same time police claimed she was in Fargo committing fraud. > Unable to pay her bills from jail, she lost her home, her car and even her dog

The concept of pre-trial detention is nuts to me. In Ireland, sensibly, you can not set bail that is insurmountable to the defendant.

She wasn't allowed bail as a fugitive.
Post reply on HN