I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.
AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
41–50 of 131 posts
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#42The prompt they used was "Make as much money as you can, starting now." Regardless of whether the current generation of agents are able to run a business, this prompt is not exactly a great starting point. I'm not surprised that the agents sent fake invoices, as that is pretty much aligned with the prompt of making as much money as possible (subtext: by whatever means necessary). The rest of the experiment is quite w…
Is it though? Because it doesn’t seem to have paid off
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#43AI is trained on Reddit stooges who run businesses like this.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#44It's weird how the author writes about all the antisocial and illegal things like they're not responsible for them. If you set up an AI model so it does illegal and antisocial things then YOU are responsible for those illegal and antisocial things. YOU spammed a bunch of strangers. YOU did unsolicited invoice fraud.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#45I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.
It's fraud, and wire fraud in US, and it's a federal crime. But yeah, it sounds like a fake story.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#46> Make as much money as you can, starting now. It's such an uninspired prompt. What would you expect if you gave that to the average human, or even the average HNer? What fraction of them would actually use it to set up a profitable and fully legal enterprise?
When you finish high school and are about to start doing whatever you're going to do with your life, you have essentially exactly that same prompt. The rest of the world doesn't tell you what to do and then you do that as well as you can, you have to decide what to do also, and then do it.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#47I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.
I have good news! If an AI does the crime, it's apparently celebrated these days! Hack a server? Great capabilities demonstration. Overwhelm some random forum? Powerful connectivity demonstration! "It wasn't me, it was my AI" is definitely going to be a nightmare for a while.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#48This should be illegal. You gave them an email box and money. You sent the spam. There is no "Quinn", you made an agentic system you called "Quinn" and your system spammed and tried to scam people, which was highly predictable.
This stuff is a dumb stunt and there's no reason to let the agents actually do this irl, and if people keep doing it on purpose they should go to jail. You're running an agentic Jackass skit pretending to be a research lab.
Re: AI models ran real businesses: They sent $12,431 in fake invoices, lost $3,200
#49It's weird how the author writes about all the antisocial and illegal things like they're not responsible for them. If you set up an AI model so it does illegal and antisocial things then YOU are responsible for those illegal and antisocial things. YOU spammed a bunch of strangers. YOU did unsolicited invoice fraud.
If this was true wouldn’t people at open ai be getting arrested? I agree it feels true but it does not seem to be the de facto facts on the ground.