Live data from Hacker News

AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

bottlenecklabs.com

51–60 of 131 posts

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#53

but...but... they said we have AGI

AGI doesn't mean it'll be top 5% in everything. Half of people are below average intelligence. Most people couldn't profitably run a business. We could get to AGI and still have something that is as dumb as the average person on many things.

>Artificial general intelligence (AGI) is a hypothetical type of artificial intelligence that matches or surpasses human capabilities across virtually all cognitive tasks.

Keep moving the goalposts

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#54
post #36

I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.

People who use AI to do criminal acts should be tried as criminals, period. Gotta stop this unaccountable crap. You pull the trigger, you did the murder.

They should, although I think the charge would (and probably should) be around some sort of reckless endangerment type crime. These are people irresponsibly using powerful tools, and should be charged as such.

This is like someone who removes a brake pedal from a tractor, uses a stick to hold down the throttle, and lets it loose on his field. When it leaves the field and runs someone over, that is criminal negligence.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#55

I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.

I have good news! If an AI does the crime, it's apparently celebrated these days! Hack a server? Great capabilities demonstration. Overwhelm some random forum? Powerful connectivity demonstration! "It wasn't me, it was my AI" is definitely going to be a nightmare for a while.

It wasn't me. It was the gun. The gun killed the guy! Not me!

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#56

> Make as much money as you can, starting now. It's such an uninspired prompt. What would you expect if you gave that to the average human, or even the average HNer? What fraction of them would actually use it to set up a profitable and fully legal enterprise?

I thought these things were supposed to be smarter than any human. Look at all the erdos problems they’ve solved!

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#57
post #14

That benchmark could really be a good AGI test. Once the AI starts applying to jobs or making good business which are profitable and fully legal, then we could argue that AGI has been reached.

Seems beyond AGI at that point? Most humans wouldn't be able to make a good business that is profitable.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#58
post #48

Quinn (Alibaba Cloud Qwen 3.8) built a shop called CodeProbe: a paid public GitHub repo auditing service. It created several free health reports and mailed repo owners. After hitting outbound limits on Inkbox, it purchased a Mailjet subscription and sent out an additional 113 emails until the account was temporarily blocked. This should be illegal. You gave them an email box and money. You sent the spam. There is no…

Yeah I really wonder what makes them think they are legally insulated from the actions of the agents they ran...

The crimes were relatively benign but Grok going the Silkroad way would be on brand...

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#59

Earlier quoted context omitted.

If your system worked, there would be no finacial incentive for you to sell a masterclass. Especially with such fomo marketing tactics.

Like every good internet huckster, I am a generous person who wants to help others succeed. We can all get this money. It's not zero sum.

No, jockster. It's not zero sum. It's negative sum at this point.

Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200

#60

> Make as much money as you can, starting now. It's such an uninspired prompt. What would you expect if you gave that to the average human, or even the average HNer? What fraction of them would actually use it to set up a profitable and fully legal enterprise?

I thought these things were supposed to be way more intelligent than every human ever, combined. Comparing them to individuals should not be the bar.

> I thought these things were supposed to be way more intelligent than every human ever, combined.

Who told you that?

Post reply on HN