Live data from Hacker News

Armed police swarm student after AI mistakes bag of Doritos for a weapon

dexerto.com

421–430 of 468 posts

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#421

Earlier quoted context omitted.

They actually don't have all the rights of a person and they do have those same responsibilities. If this company was a sole proprietorship, the only recourse this kid would have is to sue the owner, up to bankruptcy. Since it's a corporation, his recourse is to sue the company, up to bankruptcy. As for corporations having rights, I can explain it further if necessary but the key understanding is that the singular of…

You can't put a corporation in prison. But a person you can. This is one of the big problems. The people making the decisions at corporations are shielded from personal consequences by the corporation. A corporation can be shut down but it rarely happens. Even when Boeing knowingly caused the deaths of hundreds (especially the second crash was entirely preventable if they would have been honest after the first one),…

> You can't put a corporation in prison. But a person you can. This is one of the big problems.

It really isn't -- we're talking about a category of activities that involves only financial liability or civil torts in the first place, regardless of whether the parties involved are organizations or individuals. You can't put people in prison for civil torts.

Prison is irrelevant to 98% of the discussion here. And the small fraction of cases in the status quo that do involve criminal liability -- even within organizations -- absolutely do assign that liability to specific individuals, and absolutely can involve criminal penalties including jail time. Actual criminal conduct is precisely where the courts "pierce the veil" and hold individuals accountable.

> Even when Boeing knowingly caused the deaths of hundreds (especially the second crash was entirely preventable if they would have been honest after the first one), all they got were some fines.

All anyone would ever get in a lawsuit is some fines. The matter is inherently a civil one. And if there were any indications of criminal conduct, criminal liability can be applied -- as it often is -- to the individuals who engaged in it regardless of whether they are operating within an organization or on their own initiative.

The only real difference is that when you sue a large corporation, you're much more able to actually collect the damages you win than you would be if you were just suing one guy operating by himself. If the aim of justice is remunerative, not just punitive, then this is a much superior situation.

> Those just end up being charged back to their customers, a big one being the government who fined them in the first place.

Who would be paying to settle the matter in your preferred situation? It sounds like the most likely outcome is that the victims would just eat the costs they've already incurred, since there'd be little chance of collecting damages, and taxpayers would bear the burden of paying for the punishment of whomever ends up holding the hot potato after all the scapegoating and blame deflection plays out.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#422

Earlier quoted context omitted.

They actually don't have all the rights of a person and they do have those same responsibilities. If this company was a sole proprietorship, the only recourse this kid would have is to sue the owner, up to bankruptcy. Since it's a corporation, his recourse is to sue the company, up to bankruptcy. As for corporations having rights, I can explain it further if necessary but the key understanding is that the singular of…

If the company is a sole proprietorship, you can sue the person who controls it up to bankruptcy, which will affect their personal life significantly. If the company is a corporation/LLC, you can sue the corporate entity up to the bankruptcy of the corporate entity, while the people controlling the company remain unaffected. This gets even more perverse. If you're an individual you actually can't just set up an LLC t…

> If the company is a sole proprietorship, you can sue the person who controls it up to bankruptcy, which will affect their personal life significantly.

I'm sure it will. But how do you collect $30M in damages from a single individual whose entire net worth is e.g. $1M? What if the sole proprietor actually owns no assets whatsoever, because he's set up a bunch of arrangements where he leases everything from third parties, and contracts out his business operations to a different set of third parties, etc.?

I don't get why so many people are so intent on trying to attribute the motivations to maximize one's own take, deflect blame for harm away from themselves, and cover up their questionable activities to some specific organizational model. All of those motivations come from the human beings involved -- they were always present and always will be -- and those same human beings will manipulate whatever rules or institutions are involved to the greatest extent that they can.

Blaming a particular organizational model for the malicious intentions of the people who are just using that model as a tool is a deep, deep error.

> If you're an individual you actually can't just set up an LLC to limit your own liability.

What are you talking about? Of course you can. People do it all the time.

> rather as the owner you need to find and employ enough judgement-proof patsies that the whole thing becomes a "group project" and you can say you personally weren't aware of whatever problem gave rise to liability.

You're conflating entirely unrelated concepts of liability here. Limited liability as it relates to LLCs and corporations is for financial liability. It means that the organizations debts are not the shareholders' debts. It has nothing to do with legal liability for one's own purposeful conduct, whether tortious or criminal.

The kind of liability protection that you think corporations enjoy but single-member LLCs don't -- protection from the liability for individual criminal behavior -- does not exist for anyone at all.

> A person or group of people who want to exercise their personal natural rights through hired employees can always forgo the government-created liability shield and go sole proprietorship / gen partnership.

The ownership structure of a business has nothing at all to do with how it hires employees and directs their activities. The same law of agency and doctrine of vicarious liability applies to all agent-principal relationships regardless of whether the principal is a corporation or a sole proprietorship.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#423

Earlier quoted context omitted.

> a corporation refusing to take responsibility for literally anything. How passe Versus all the natural people at the highest echelons of our political economic system valiantly taking responsibility for fuckall?

> Versus all the natural people We can at least hold them responsible.

You can try, but you might be unknowingly holding their carefully designated scapegoat responsible instead.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#424

Earlier quoted context omitted.

> We can at least hold them responsible We don’t. (We can also hold corporations responsible. We seldom do.) The problem isn’t in the form of legal entity fraud and corruption wears.

Fair enough, but it is much harder to hold a corporation responsible. Jail is a great deterrent for natural persons.

Jail is a great deterrent against criminal conduct. But natural persons are already risking jail when they engage in criminal conduct regardless of whether they're doing so within the scope of an organization or doing so on their own initiative.

Jail isn't on the table for financial liability or civil torts in the first place, and since pretty much all the forms of liability involving commercial conduct we're discussing here are financial liability or civil torts, it's not really relevant to the discussion.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#425

Earlier quoted context omitted.

In marketing, that's called "the bandwagon effect" and is one of the more powerful techniques for influencing people's thoughts and behaviors. Sadly, we are social animals and "social proof" is far more powerful than it should be.

Well now bots and AI get to amplify tge effect

"Everybody loves AI, 23.1 billion internet users couldn't possibly be wrong."

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#426
"I am invoking my 4th and 5th amendment rights afforded to me by the Constitution of the United States of America. I have no further comment until I have consulted with and am in the presence of my legal council."

Then, just sit back and enjoy as the lawsuit unfolds.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#427
post #422

Earlier quoted context omitted.

If the company is a sole proprietorship, you can sue the person who controls it up to bankruptcy, which will affect their personal life significantly. If the company is a corporation/LLC, you can sue the corporate entity up to the bankruptcy of the corporate entity, while the people controlling the company remain unaffected. This gets even more perverse. If you're an individual you actually can't just set up an LLC t…

> If the company is a sole proprietorship, you can sue the person who controls it up to bankruptcy, which will affect their personal life significantly. I'm sure it will. But how do you collect $30M in damages from a single individual whose entire net worth is e.g. $1M? What if the sole proprietor actually owns no assets whatsoever, because he's set up a bunch of arrangements where he leases everything from third par…

> how do you collect $30M in damages from a single individual

It's not about getting made whole from damages, it's about the incentives for the business owner. A sole proprietor has their own skin fully in the game, whereas an LLC owner does not (only modulo things customarily shielded from bankruptcy like retirement savings and primary dwelling, and asset protection strategies for the extremely rich, like charitable foundations)

> I don't get why so many people are so intent on trying to attribute the motivations to maximize one's own take, deflect blame for harm away from themselves, and cover up their questionable activities to some specific organizational model

Because this specific legal structure (not organizational model, that is orthogonal) is a powerful tool for deflecting blame.

> You're conflating entirely unrelated concepts of liability here... It has nothing to do with legal liability for one's own purposeful conduct, whether tortious or criminal

The point is that these concepts are quite intertwined for small businesses, and only become distinct when there are enough people involved to make a nobody's-fault "group project". Let's say I want to own a piece of rental property and think putting it in an LLC will protect my personal life from all the random things that might happen playing host to other people's lives. Managing one property doesn't take terribly much time so I do it myself. Now it snows, the tenant does a crappy job of shoveling, and someone slips on the sidewalk up front, gets hurt, and sues. Since I'm personally involved in supervising the condition of the property, there is now a theory of personal liability for me that I should have been aware of the poor conditions of the sidewalk. (This same liability applies to the tenant, or anyone that was hired to shovel, but they're usually judgement proof, sympathetic, etc).

Same thing with making repairs to the property, etc - any direct involvement (supplying anything but investment capital) opens up avenues for personal liability, negating the LLC protections.

> The same law of agency and doctrine of vicarious liability applies

The point is that LLC/corporate structures allow for much higher levels of scaling, allowing them to apply higher levels of coercion to their employees. Since these limited liability structures are purely creations of government (rather than something existing outside of government), it's straightforwardly justifiable to regulate what activities they may engage in to mitigate this coercion.

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#428

We blame AI here but what's up with law enforcment that comes with loaded guns in hand and send someone to the ground and cuff him before actually doing any check? That is the real issue. Police force anywhere else in the world that know how to behave would have approched the student, have had a small chat with him, found out all he had in hands was a bag of doritos, maybe would have asked politely to see the content…

>That is the real issue.

No. Trusting AI is clearly the issue.

If there was a 9-1-1 call to the police that there was an active shooter at your kids school, how would you want the police to show up?

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#429
Looks like per their website it did function as intended... It surfaces potential threats for the school to look at and make a human decision. The principal decided to send the police after the school safety team dismissed it as part of the correct process. I mean fire alarms go off for lots of things that are not fire alarms... This was an alert meant to be validated by a human that messed up.

Its pretty clearly documented how it works here:

https://www.omnilert.com/solutions/gun-detection-system https://www.omnilert.com/solutions/ai-gun-detection https://www.omnilert.com/solutions/professional-monitoring

Re: Armed police swarm student after AI mistakes bag of Doritos for a weapon

#430

This may be mean, but we should really be careful about just handing AI over to technically illiterate people. They're far more likely to blind trust the LLM/AI output than someone who may be more experienced and take a beat. AI in an agentic-state society (what we have in America at least) is an absolute ticking time bomb. Honestly, this is what AI safety teams should be concentrated on: making sure people who think…

It's basically a failure of setting up the proper response playbook.

Instead of:

1. AI detects gun on surveillance

2. Dispatch armed police to location

It should be:

1. AI detects gun on surveillance

2. Human reviews the pictures and verifies the threat

3. Dispatch armed police to location

I think the latter version is likely what already took place in this incident, and it was actually a human that also mistook a bag of Doritos for a gun. But that version of the story is not as interesting, I guess.

Post reply on HN