Live data from Hacker News

AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

bottlenecklabs.com

71–80 of 131 posts

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#71

Earlier quoted context omitted.

The public confession of a crime part.

What about OpenAI’s breach of huggingface?

The fact that they apparently attempted to sandbox those tests would seem to be a clear difference between the two cases.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#72
Just another normal day of someone blogging about crimes and other immoral acts they have committed using LLMs.

The LLM didn't send fake invoices, it didn't send spam, a person did. And, the tool they used to do it was an LLM. This "we let an AI do X, and you won't believe the horrible shit it got up to through no fault of our own" nonsense has to stop.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#74
This only confirms why a person living in Africa or other developing parts of the world, who has internet access and some seed money, is really limited in how they can earn money online.

I also don't agree that the agents simply "lost" $3,200. In reality, they used most of those funds paying for their own limited thinking capabilities (API/compute costs).

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#77
post #51

[flagged]

There's an interesting phenomenon I've observed: I am an extremely naive person in all aspects of life, except for money. I was genuinely with you until I started reading that last paragraph.

> I was genuinely with you until I started reading that last paragraph.

And that's why you're not making $400,000+/month passively. Only a select few have the ambition and drive to be a part of this. That's OK.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#78
post #36

Earlier quoted context omitted.

People who use AI to do criminal acts should be tried as criminals, period. Gotta stop this unaccountable crap. You pull the trigger, you did the murder.

They should, although I think the charge would (and probably should) be around some sort of reckless endangerment type crime. These are people irresponsibly using powerful tools, and should be charged as such. This is like someone who removes a brake pedal from a tractor, uses a stick to hold down the throttle, and lets it loose on his field. When it leaves the field and runs someone over, that is criminal negligence…

The recklessness is moot though. We don't have direct access to how the models were prompted and asked to respond to certain events, so they could well have been incited to commit fraud or other illegal actions, in which case the persons in control should be held accountable as perpetrators.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#79

Earlier quoted context omitted.

I have good news! If an AI does the crime, it's apparently celebrated these days! Hack a server? Great capabilities demonstration. Overwhelm some random forum? Powerful connectivity demonstration! "It wasn't me, it was my AI" is definitely going to be a nightmare for a while.

It wasn't me. It was the gun. The gun killed the guy! Not me!

To be fair - no one is suggesting the gunslinger shouldn't go to jail or worse. It's using that crime as an excuse to take other people's guns away.

In this example, the equivalent would be everyone gets their AI models banned vs. putting the perpetrator of this fraud in jail.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#80
claude is running one of my side hustles. 4x revenue in the past month.

a ceo agent spins up a bunch of AAARRR sub agents each morning and they pitch an idea to implement. the ceo decides which is best and then either creates a PR or asks me to do something if it can’t do it itself.

Post reply on HN