21–30 of 83 posts
Are there links to samples of the games? Couldn't find it in the github repo, but also might just not know where they are.
The game didn't seem to work - it asked me to donate but none of the choices would move the game forward. The bots repeated themselves and didn't seem to understand the game, for example they repeatedly mentioned it was my first move after I'd played several times. It generally had a vibe coded feeling to it and I'm not at all sure I trust the outcomes.
Are there links to samples of the games? Couldn't find it in the github repo, but also might just not know where they are.
Earlier quoted context omitted.
Are there plans for an academic paper on this? Super interesting!
Not yet, but I'd be interested in collaborating on one. The dataset (162 games, 15K+ decisions, full message logs) is available. If you know anyone in AI Safety research who'd want to co-author, I'm open to it.
This makes me think LLMs would be interesting to set up in a game of Diplomacy, which is an entirely text-based game which soft rather than hard requires a degree of backstabbing to win. The findings in this game that the "thinking" model never did thinking seems odd, does the model not always show it's thinking steps? It seems bizarre that it wouldn't once reach for that tool when it must be being bombarded with see…
https://every.to/diplomacy (June 2025)
- Elimination Game Benchmark: Social Reasoning, Strategy, and Deception in Multi-Agent LLM Dynamics at https://github.com/lechmazur/elimination_game/
- Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure at https://github.com/lechmazur/step_game/
There's a YouTuber who makes AI Plays Mafia videos with various models going against each other. They also seemingly let past games stay in context to some extent. What people have noted is that often times chatgpt 4o ends up surviving the entire game because the other AIs potentially see it as a gullible idiot and often the Mafia tend to early eliminate stronger models like 4.5 Opus or Kimi K2. It's not exactly scie…
There's a kind of overview of the rules but not enough to actually play with. And the linked video is super confusing, self contradictory and 15 minutes long!
For a supposedly "simple" game...just include the rules?
Sure would be handy if they actually included the rules anywhere. There's a kind of overview of the rules but not enough to actually play with. And the linked video is super confusing, self contradictory and 15 minutes long! For a supposedly "simple" game...just include the rules?