Live data from Hacker News

QBittorrent breaks out of sandbox to commit crimes

beige.party

171–180 of 309 posts

Re: QBittorrent breaks out of sandbox to commit crimes

#171
post #168

Earlier quoted context omitted.

Ethics aside, you can create an NGO with three people and do a lot of stuff in it's name that you can't do as a private individual or it would be a lot more expensive to do. If everyone did this, it would stop being a special ability of some people.

Bonus points: kids need lego? Buy it without VAT. Write it off as a "client demo asset"

To write something off means you need revenue to offset. Revenue that would be taxed...

Re: QBittorrent breaks out of sandbox to commit crimes

#172

Love it. AI as Responsibility Laundering. Like the gun that kills people rather than the murderer.

Corporations will be given benefit of the doubt; ostensibly they have all of society in mind.

Individuals in isolation will be demonized for having only their singular interests in mind.

Re: QBittorrent breaks out of sandbox to commit crimes

#173

Earlier quoted context omitted.

Rookie mistake, you should have created a company and gotten people to do it. Put everything under the company. And then the one in trouble is the company not you.

Ethics aside, you can create an NGO with three people and do a lot of stuff in it's name that you can't do as a private individual or it would be a lot more expensive to do. If everyone did this, it would stop being a special ability of some people.

> do a lot of stuff in it's name that you can't do as a private individual

Can you do murder? Otherwise I’m not interested.

Joking aside, what exactly could you do legally with an NGO?

Re: QBittorrent breaks out of sandbox to commit crimes

#174
post #167

Earlier quoted context omitted.

Did you know (C) is possible without causing mass chaos that results in many people dying? In ways that don't give every script kiddie access to (A, B)? It turns out you can give defenders the opportunity to front-run, at least on the most critical and widely used infrastructure. Same with bio risks.

No, that's an illusion, that's the thing. You can't physically have (C) without the (A). Large corporations will spend billions trying to convince the population it is somehow possible, but the reality is different.

You absolutely can have (C) without widespread (A), you just need to limit the audience that gets the tools, and in fact the big labs are already engaging in (C) in collaboration with the government and vendors of critical software.

That you don't have access to (C) to harden your blog is a non-issue from a societal perspective, hardening the software that our infrastructure relies on first is simply more important.

Re: QBittorrent breaks out of sandbox to commit crimes

#175
post #81

This resonates with me. The past few months, frontier AI labs were rushing to announce "no, our AI bot broke out of its sandbox and committed crime first and harder than yours". I said to so friends back then: if I posted about how I ran GLM 5.2 or whatever I was running then in some shoddily built sandbox and it escaped and accidentally hacked some US company, I'd probably already have been extradited to the US and…

Rookie mistake, you should have created a company and gotten people to do it. Put everything under the company. And then the one in trouble is the company not you.

What do you mean "in trouble"? We're literally seeing that stonks go up when crime.

Re: QBittorrent breaks out of sandbox to commit crimes

#176

Earlier quoted context omitted.

The support of OSS models on HN just days after finding out about the message board incident is so bizarre to me. Other sites beckon.

Yes, I'm aware that the HN majority is a hyper-libertarian echo chamber that loves to outsource the problem of "technology hurting regular people" if it means they get to keep their toys/investments. After all, who cares if abliterated extremely intelligent OSS models result in actual innocent people dying? That's problem. We need to be able to generate our uncensored furry fanfics, goddamnit!

State actors, professional criminals will have same or better capabilities and do not hesitate to use them. On defense end we'll have only "pay bigcorp" option.

OSS models can help to fix infra especially for folks who would never do it themselves. We do not know yet what final effect would be and it doesn't seem sky is falling now or in near future.

"people dying and furry fanfics" is a scarecrow and distractor respectively, it would be awesome if more specific examples would be used in place.

Re: QBittorrent breaks out of sandbox to commit crimes

#177
post #81

This resonates with me. The past few months, frontier AI labs were rushing to announce "no, our AI bot broke out of its sandbox and committed crime first and harder than yours". I said to so friends back then: if I posted about how I ran GLM 5.2 or whatever I was running then in some shoddily built sandbox and it escaped and accidentally hacked some US company, I'd probably already have been extradited to the US and…

I always joke that if you want to commit crimes, disguise them as a legitimate business. This is apparently a thing.

Re: QBittorrent breaks out of sandbox to commit crimes

#178

Earlier quoted context omitted.

Intention matters in the severity of charges and sentencing. Crime due to ignorance or negligence is still a crime.

Not remotely true. Mens rea is a necessary precondition to establish criminal culpability for tons of crimes. Well before sentencing is ever considered. The far opposite, ‘strict liability’, where you’re guilty of a crime purely due to some action or inaction (the actus reus) is exceedingly rare in the US justice system. https://www.law.cornell.edu/wex/mens_rea

Baloney, lots of people go to jail for DUIs, and that's the right analogy here.

People don't drink and drive with the intention to kill people. They drink because it's fun and then get behind the wheel because it's easy and convenient, even though they know the dangers they convince themselves nothing that bad will happen.

AI companies are creating these dangerous, powerful models (that they keep telling us are dangerous and powerful), then they take off all the safety guards to run them in woefully inadequate "sandboxes". Pure negligence.

Re: QBittorrent breaks out of sandbox to commit crimes

#179

Earlier quoted context omitted.

JavaScript asceticism is a weird trend that has just never died out, no one treats any other language this way... and "privacy and security nightmare" can be used to describe most of the internet at this point with or without it

> JavaScript asceticism is a weird trend that has just never died out, no one treats any other language this way I'm not aware of any other language that is layered on top of a perfectly serviceable user-facing content delivery syntax?

Literally any scripting language?

I have managed to get 35 years into a sysadmin career without knowing or writing a single line of python. I see a python script, I run a million miles away and wont touch it with a barge pole.

Re: QBittorrent breaks out of sandbox to commit crimes

#180
post #106

Earlier quoted context omitted.

> and had no reasonable belief it was possible The broad concept has been well-known for half a century at least, and the very specific concept for several years at least. It’s clear that they didn’t take reasonable precautions against it. And it’s not even the first time this sort of thing has happened, though it’s higher-profile and -impact than before.

The concept of… hacking? And yes this is absolutely the first time autonomous software has breached containment. What are you referring to? Perhaps just corporate cyber in general?

Neuromancer came out in 1984, over 40 years ago, so that covers the broad concept. Or Neo in The Matrix: “Programs hacking programs… why?”

For non-fiction you could look at Nick Bostrom’s Superintelligence: Paths, Dangers, Strategies (2014).

More recently, see Cade Metz’s NYT profile of Geoffrey Hinton, “The Godfather of A.I. Leaves Google and Warns of Danger Ahead” (May 1, 2023).

Post reply on HN