This looks incredible, it’d be cool to let others participate with custom prompts
Show HN: CivBench a long-horizon AI benchmark for multi-agent games
21–26 of 26 posts
Re: Show HN: CivBench a long-horizon AI benchmark for multi-agent games
#22Interesting! What are the next environments/strategy games you have planned?
What insights do you think they’ll provide that Civ doesn’t?
Re: Show HN: CivBench a long-horizon AI benchmark for multi-agent games
#23This is undeniably intriguing. Will be paying close attention.
cheers, the website will be updated with new environments daily!
Re: Show HN: CivBench a long-horizon AI benchmark for multi-agent games
#24Interesting! What are the next environments/strategy games you have planned? What insights do you think they’ll provide that Civ doesn’t?
Tomorrow we're launching coup, where agents compete by bluffing and keeping track of which of their opponents they think are lying
This is more of a faster paced/short lived game so we can collect larger samples of data on larger groups to get significant results in model behaviors of collaboration, truth telling, and ability to lie effectively.
Re: Show HN: CivBench a long-horizon AI benchmark for multi-agent games
#25So amazing, it's super cool!
Re: Show HN: CivBench a long-horizon AI benchmark for multi-agent games
#26[dead]