Live data from Hacker News

Armed police swarm student after AI mistakes bag of Doritos for a weapon

dexerto.com

41–50 of 468 posts

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#41
post #7

Walking through TSA scanners, I always get that unnerving feeling I will get pulled aside. 50% of the time they flag my cargo pants because of the zipper pockets - There is nothing in them but the scanner doesn't like them. Now we get the privilege of walking by AI security cameras placed in random locations, hoping they don't flag us. There's a ton of money to be made with this kind of global frisking, so lots of pr…

Why don’t you pay the bribe and skip the security theater scanner? It’s cheap. Most travel cards reimburse for it too.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#42

If these AI video based gun detectors are not a massive fraud I will eat one. How on Earth does a person walk with a concealed gun? What does a woman in a skirt with one taped to her thigh walk like? What does a man in a bulky sweatshirt with a pistol on his back walk like? What does a teenager in wide legged cargo jeans with two pistols and a extra magazines walk like?

The brochure linked from TFA has a screenshot of a combination of segmentation and object recognition models which are fairly standard in NVRs. Quick skim of the vendor website seems to confirm this[1] and states a claim that they are not analyzing the gait.

[1]: https://www.omnilert.com/blog/what-is-visual-gun-detection-t...

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#43

I think the most amazing part is that the school doubled down on the mistake by parroting the corporate line. I expect a school to be smart enough to say “Yes, this is a terrible situation, and we’re taking a closer look at the risks involved here.”

Lawyer's advice?

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#44
post #30

> “They didn’t apologize. They just told me it was protocol. I was expecting at least somebody to talk to me about it.” I wonder how effective an apology and explanation would have been? Just some respect.

Effective at what? No one is facing any consequences anyway.

Except for the kids who experienced the “rapid human verification” firsthand.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#45
post #3

>Omnilert later admitted the incident was a “false positive” but claimed the system “functioned as intended,” saying its purpose is to “prioritize safety and awareness through rapid human verification.” It's ok everyone, you're safer now that police are pointing a gun at you, because of a bag of chips ... just to be safe. /s Absolutely ridiculous. We're living "computer said you did it, prove otherwise, at gunpoint".

The safest thing to do is to pull all Frito Lay products off shelves until the packaging can be redesigned to ensure that AI never confuses them for guns. It's a liability issue. THINK OF THE CHILDREN.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#46

If these AI video based gun detectors are not a massive fraud I will eat one. How on Earth does a person walk with a concealed gun? What does a woman in a skirt with one taped to her thigh walk like? What does a man in a bulky sweatshirt with a pistol on his back walk like? What does a teenager in wide legged cargo jeans with two pistols and a extra magazines walk like?

The whole idea even accepting the core premise is OK to begin with needs to have a similar analysis applied to it that medical tests do: will there be enough false positives, with enough harm caused by them, that this is actually worse than doing nothing? Compared with likelihood of improving an outcome and how bad a failure to intervene is on average, of course.

Given that there's no relevant screening step here and it's just being applied to everyone who happens to be at a place it's truly incredible that such an analysis would shake out in favor of this tech. The false positive rate would have to be vanishingly tiny, and it's simply not plausible that's true. And that would have to be coupled with a pretty low false negative rate, or you'd need an even lower false positive rate to make up for how little good it's doing even when it's not false-positiving.

So I'm sure that analysis was either deliberately never performed, or was and then was ignored and not publicized. So, yes, it's a fraud.

(There's also the fact that as soon as these are known to be present, they'll have little or no effect on the very worst events involving firearms at schools—shooters would just avoid any scheme that involved loitering around with a firearm where the cameras can see them, and count on starting things very soon after arriving—like, once you factor in second order effects, too, there's just no hope for these standing up to real scrutiny)

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#47
post #3

>Omnilert later admitted the incident was a “false positive” but claimed the system “functioned as intended,” saying its purpose is to “prioritize safety and awareness through rapid human verification.” It's ok everyone, you're safer now that police are pointing a gun at you, because of a bag of chips ... just to be safe. /s Absolutely ridiculous. We're living "computer said you did it, prove otherwise, at gunpoint".

We got our cyberpunk future, except none of it's cool and everything's extremely stupid.

Pretty sure cyberpunk was always this dark.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#48

Ah, the coming age of Palantir's all seeing platform; and Peter Thiel becoming the shadow Emperor. Too bad non-deterministic ml systems are prone to errors that risk lives when applied wrongly to crucial parts of society. But in an authoritarian state, those will be hidden away anyway, so there's nothing to see here: move along folks. Yes, surveillance and authoritarianism go hand in hand, ask China. It's important t…

The article is about omnialert, not palantir, but don’t let the facts get in the way of your soapbox rant.

Same fallible systems, same end goal of mass surveillance.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#49

Ah, the coming age of Palantir's all seeing platform; and Peter Thiel becoming the shadow Emperor. Too bad non-deterministic ml systems are prone to errors that risk lives when applied wrongly to crucial parts of society. But in an authoritarian state, those will be hidden away anyway, so there's nothing to see here: move along folks. Yes, surveillance and authoritarianism go hand in hand, ask China. It's important t…

[flagged]

[deleted]

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#50
post #20
post #8

This is only the beginning of AI-hallucinated policing. Not a good start, and I don't think it's going to end well for citizens.

"end well for citizens." That ship has long sailed buddy.

Yeah ask all those citizens getting “detained” by ICE how it worked out for them.
Post reply on HN