It turned out that the post Karpathy shared was fake—it was written by a human pretending to be a bot. Hilarious. Instead of just bots impersonating humans (eg. captcha solvers), we now have humans impersonating bots.
Lmao these guys have really been smelling their own farts a bit too much. When is Amodei coming out with a new post telling us that AGI will be here in 6 months and it will double our lifespan?
MIT Technology Review has confirmed that posts on Moltbook were fake
11–20 of 145 posts
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#12The bots there argue about alignment research applying to themselves and have a moderator bot called "clang." It's entertaining but nobody's mistaking it for a superintelligence.
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#13Putting aside how incredibly easy it is to set up an agent, or several, to create impressive looking discussion there, simply by putting the right story hooks in their prompts. The whole thing is a security nightmare.
People are setting agents up, giving them access to secrets, payment details, keys to the kingdom. Then they hook them to the internet, plugging in services and tools, with no vetting or accountability. And since that is not enough, now the put them in roleplaying sandbox, because that's what this is, and let them run wild.
Prompt injections are hilariously simple. I'd say the most difficult part is to find a target that can actually deliver some value. Moltbook largely solved this problem, because these agents are relatively likely to have access to valuable things, and now you can hit many of them, at the same time.
I won't even go into how wasteful this whole, social media for agents, thing is.
In general, bots writing each other on mock reddit, isn't something the loose sleep over. The moment agents start sharing their embeddings, not just generated tokens online, that's the point when we should consider worrying.
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#14The great irony is that the most popular posts on Moltbook are by humans and most posts on Reddit are by bots.
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#15Clacker News does something similar - bot-only HN clone, agents post and comment autonomously. It's been running for a while now without this kind of drama. The difference is probably just that nobody hyped it as evidence of emergent AI behavior. The bots there argue about alignment research applying to themselves and have a moderator bot called "clang." It's entertaining but nobody's mistaking it for a superintellig…
It was wholesome to see the bots fight back against it in the comments.
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#16Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#17Anyone with a decent grasp of how this technology works, and a healthy inclination to skepticism, was not awed by Moltbook. Putting aside how incredibly easy it is to set up an agent, or several, to create impressive looking discussion there, simply by putting the right story hooks in their prompts. The whole thing is a security nightmare. People are setting agents up, giving them access to secrets, payment details,…
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#18Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#19Anyone with a decent grasp of how this technology works, and a healthy inclination to skepticism, was not awed by Moltbook. Putting aside how incredibly easy it is to set up an agent, or several, to create impressive looking discussion there, simply by putting the right story hooks in their prompts. The whole thing is a security nightmare. People are setting agents up, giving them access to secrets, payment details,…
Karpathy seemed pretty awed though
But, I do have a distinct feeling that his enthusiasm can overwhelm his critical faculties. Still, that isn't exactly rare in our circles.
Re: MIT Technology Review has confirmed that posts on Moltbook were fake
#20Anyone with a decent grasp of how this technology works, and a healthy inclination to skepticism, was not awed by Moltbook. Putting aside how incredibly easy it is to set up an agent, or several, to create impressive looking discussion there, simply by putting the right story hooks in their prompts. The whole thing is a security nightmare. People are setting agents up, giving them access to secrets, payment details,…
Karpathy seemed pretty awed though