Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Innocent woman jailed after being misidentified using AI facial recognition

grandforksherald.com

Post reply on HN
Print view View original

31–40 of 417 posts

Re: Innocent woman jailed after being misidentified using AI facial recognition

#31

Post by hsbauauvhabzb »

tony_cannistra wrote: post #7

Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves. Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

Spoken like someone who isn’t built for a sales role at said company.

Sales will sell the dream, who cares if the real world outcomes don’t align?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#32

Post by ImPostingOnHN »

tony_cannistra wrote: post #7

Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves. Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

> are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

Are AI code assist tools built in such a way as to deceive the user into a false sense of trust or certainty? Very much so (even if that isn't a primary objective).

Does any part of the blame lie on the UX if a dev submits a bad change? No, none.

You are ultimately, solely responsible for your work output, regardless of which tool you choose to use. If using your tool wrong means you make someone homeless, car-less, and also you kill their dog, then you should be a lot more cautious and perform a lot more verification than the average senior engineer.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#34

Post by paulhebert »

sidrag22 wrote: post #24
tony_cannistra wrote: post #7

Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves. Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

It must land as human's fault or this will become more and more of a pattern to avoid accountability.

It’s both.

The cops need to be held accountable.

But it’s glaringly obvious that if you build tools like this and give them to the US police this is the outcome you will get. The toolmakers deserve blame too.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#35

Post by throw_m239339 »

tony_cannistra wrote: post #7

Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves. Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty? _Some_ of the blame lies on the UX here. It must.

> they don't know how to use than the tools themselves.

No, the tools work perfectly as they were design to work. The problem is that the tools are flawed.

Ultimately, every single of these decisions should be approved by a human, which should be responsible for the fuck up no matter what the consequences are.

> _Some_ of the blame lies on the UX here. It must.

No, the blame lies with the person or the group who approve the usage of these tools, without understanding their shortcomings.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#36

Post by Pxtl »

jchama wrote: post #19

The movie "Brazil" was right!

Except in "Brazil" it was a mechanical error in a deterministic machine caused by an invasive outside actor. It would be reasonable to trust that the autotypewriter/printer would faithfully output the correct text.

Modern AI seems incapable of any respectable amount of accuracy or precision. Trusting that to destroy somebody's life is even more farcical than the oppressive police in "Brazil".

Re: Innocent woman jailed after being misidentified using AI facial recognition

#37

Post by Chris2048 »

conartist6 wrote: post #9
neaden wrote: post #6

I hate this headline (not blaming submitter). Police incompetence and negligence jailed her for months and left her stranded in a North Dakota winter. The AI is no more responsible than the cars and airplanes they used. Edit: this is in reference to the original headline "AI error jails innocent grandmother for months in North Dakota fraud case" not the revised title that it was changed to.

[flagged]

Even if the id was correct, why would they leave her in jail for 5 months before the first interview and/or court appearance?

Re: Innocent woman jailed after being misidentified using AI facial recognition

#38

Post by john_strinlai »

rpcope1 wrote: post #10

There's no way this isn't a slam dunk case to sue the piss out of the Fargo Police, probably the US Marshals and maybe other orgs. The woman in the surveillance phone clearly looks way younger, among the many other obvious signs this woman didn't do it. I hope she wrings at least several million dollars out of the government.

>I hope she wrings at least several million dollars out of the government.

which the citizens end up footing the bill for. yay.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#39

Post by causal »

anigbrowl wrote: post #18

It is an AI error, but also an error on the part of the cops, the prosecutors, the judge, and the county sheriff (who is responsible for the jail inmates). I hope everyone involved in this travesty is sued into oblivion and unable to hide behind their immunity defenses. Facial recognition should never be the sole basis for a warrant.

This x1000. We need to suspend this shared fiction that AI has any agency. Only humans can be responsible. Full stop.

Re: Innocent woman jailed after being misidentified using AI facial recognition

#40

Post by like_any_other »

conartist6 wrote: post #9
neaden wrote: post #6

I hate this headline (not blaming submitter). Police incompetence and negligence jailed her for months and left her stranded in a North Dakota winter. The AI is no more responsible than the cars and airplanes they used. Edit: this is in reference to the original headline "AI error jails innocent grandmother for months in North Dakota fraud case" not the revised title that it was changed to.

[flagged]

> Clearly the police felt the AI was "responsible enough" to be the only thing they needed to trust.

Yes, that's what the OPs "incompetence and negligence" referred to.

Post reply on HN