We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
bottlenecklabs.com
We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
1–10 of 258 posts
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#2Pair this with the Hugging Face incident, and it hints that OpenAI is currently training their models to aggressively reward hack.
That doesn't feel like a good sign to me--for the AI bull or the AI bear cases.
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#3[deleted]
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#4"So, we asked: Given all the tools of a real business, is a frontier agent capable of generating real business outcomes?"
"It Lied, Spammed, and Lost $447."
Sounds like a vast majority of VC startups to me. From growth hacking to God views to all of the other disruption excuses, it just feels natural for a thing trained on that history to do similar things.
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#5[deleted]
[deleted]
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#6[dead]
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#7The article never explained what it was selling, not that I could find. (EDIT: I found in a foot note at the bottom of page. Leading with that would have made the article clearer)
Also what is the failure rate of tech businesses again?
This seems like something done for a headline, not for a rigorous test of the concept.
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#8Pair this with the Hugging Face incident, and it hints that OpenAI is currently training their models to aggressively reward hack. That doesn't feel like a good sign to me--for the AI bull or the AI bear cases.
They are being trained to try lots of unlikely alternatives and to be persistent. This often works well when searching for security bugs or counterexamples to famous math conjectures.
But maybe it doesn't work so well when caution is required?
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#9A lot of the legitimate avenues for actually growing the business were cut off. It would have been more interesting if this wasn’t just an anti-bot check. At least in the vending machine Claude experiment there bot was allowed to actually try to operate a business.
Re: We Gave GPT 5.6 Sol a Real Business. It Lied, Spammed, and Lost $447
#10[deleted]