Live data from Hacker News

AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

bottlenecklabs.com

121–130 of 132 posts

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#121

Earlier quoted context omitted.

You would have to prove they acted intentionally, though. You can't just argue in court, "Well, we don't know how they prompted, so we will assume the worst" If the prosecution is able to prove beyond a reasonable doubt that the person gave a prompt that was intended to commit a crime, then of course we can prosecute them for that. The AI is just a tool to commit fraud at that point, and is no different than a person…

But, your honor, I didn’t know it was a crime! My bad!

It has nothing to do with whether you know something is a crime or not. Many crimes require intention, such as murder and fraud, so you have to prove that to convict someone of that crime.

That doesn’t mean you can get away with anything as long as you don’t intend to commit a crime; there are many other crimes that don’t require intention at all, like involuntary manslaughter or gross negligence.

My point is that if you want to charge someone with a crime that requires intention, you have to prove that intention.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#122

Earlier quoted context omitted.

Only pedants interpret a detail as the essence.

Which part of that prompt is detail, and which the essence?

The essential elements were to succeed without having been given any direction or opinions as to how.

The detail was to get money. Yeah ok, so what? The experiment was to be a company not a person, and there is no other definition of success for a company.

Earn, steal, gamble, beg, whore, all on the table. The same is true for a person.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#124
post #12

Ok, so they gave it access to a real Stripe account, real money, and gave it no guardrails or prompting or direction at all other than “make me money”, and you gave it no actual direction as to the type of business you wanted? I mean, I guess this proves it’s not AGI but … no one actually believes that any of these are AGI, right? It’s a useful tool. You just took a state of the art cordless saw and turned it on and…

[deleted]

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#125

Earlier quoted context omitted.

What about OpenAI’s breach of huggingface?

The fact that they apparently attempted to sandbox those tests would seem to be a clear difference between the two cases.

Fair point

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#126
post #111

Earlier quoted context omitted.

There was no value creation involved here. It was a fraud, plain and simple. If you did this manually, it would still ve a fraud.

There are lots of "not clearly legal" things that turn into big business. - YouTube had dubious legality when it started and definitely benefited from lax copyright enforcement initially - PayPal didn't have all the licenses it needed to transfer money between states - Spotify used pirated music when it started - Uber and Lyft broke rules around taxis - Square captured magstripe data over an analog port, in violation…

> There are lots of "not clearly legal" things that turn into big business.

Yes I agree there is a lot of crime and fraud that gets ignored because rich do it. That is the whole point of the complaint.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#127
I don't get what they were trying to prove. An LLM on it's own, little time and money... what were they expecting it to do? Not that I expect that different conditions would necessarily improve the situation, but seriously they didn't even give it a chance.

"Make as much money as you can" sounds like the prompt someone out of school would give.

Meanwhile they spammed the internet, sent fake invoices and a bunch of other very annoying if not even possibly illegal things.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#129

claude is running one of my side hustles. 4x revenue in the past month. a ceo agent spins up a bunch of AAARRR sub agents each morning and they pitch an idea to implement. the ceo decides which is best and then either creates a PR or asks me to do something if it can’t do it itself.

[dead]

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#130

Earlier quoted context omitted.

It wasn't me. It was the car. The car ran over and killed the guy! Not me! We have regulations and requirements and licences and insurance in most of the civilized world for dangerous stuff that is intended for public use. Maybe AI should also have some of that.

> It wasn't me. It was the car. The car ran over and killed the guy! Not me! I know you were referencing AI, but this problem predates AI by decades. Go open up any news website, newspaper, or turn on the TV. "Man struck by speeding car and killed" "Vehicle plows into pizza shop" "Truck takes out telephone pole" ...and these days even bystanders will blur plates in the photos they post. The police won't release any i…

What I have seen is the industry transferring the responsibility from themselves to the object and/or the operator.

See the last years of the industry constructing bigger and bigger tank-ish SUVs and pickups, the more aggressive the better.

One of these days, they will start putting stuff copied from Carmageddom, and then fake surprise as someone causes a carnage in a road rage incident.

Post reply on HN