Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A real-time strategy game that AI agents can play

llmskirmish.com

Post reply on HN
Print view View original

51–60 of 88 posts

Re: Show HN: A real-time strategy game that AI agents can play

#51

Post by FusspawnUK »

Took a crack at this earlier. the leader board is a little weird. seems to be like 2 real dudes and the rest are fake profiles. a Scores resetting on each new upload also encourages leaving changes unimplemented in the hopes of getting more battles over time.

The largest winner having 50 wins against 14 other opponents for instance). That guy adding a new script would instantly plummet down the leader board capping out at 14 wins again, Putting it below the 2nd place user.

The leader board will quickly become "who can have a mostly competent AI and never change it" over who actually has the better script.

Re: Show HN: A real-time strategy game that AI agents can play

#52

Post by __cayenne__ »

david3289 wrote: post #31

This is a really interesting direction. RTS games are a much better testbed for agent capability than most static benchmarks because they combine partial observability, long-term planning, resource management, and real-time adaptation. It reminds me a bit of OpenAI Five — not just because it played a complex game, but because the real value wasn’t “AI plays Dota,” it was observing how coordination, strategy formation…

Very interested in self-play training loops, but I do like codegen as an abstraction layer. I am planning to make it available as an RL environment at some point

Re: Show HN: A real-time strategy game that AI agents can play

#53

Post by sails »

I’m doing something similar to simulate llms in b2b lending, it’s slightly slower paced but the core mechanisms are using just-bash to analyse business financials and make profitable loans.

I quite like the idea of llms writing more code up front to execute strategies.

I’m currently developing the game mechanics and ELO. Please share anything relevant if it comes to mind

Re: Show HN: A real-time strategy game that AI agents can play

#54

Post by giancarlostoro »

jack6e wrote: post #46
giancarlostoro wrote: post #44

Reminds me of Screeps, which I never took the time to fully play, but now I'm wondering if using Claude Code to play Screeps is cheating. Additionally, Screeps lets you host your own backend... What if we started benchmarking coding LLMs with Screeps?... Oh God... If anyone wants to do this let me know, I don't want to burn money on every LLM out there... I'll throw in my Claude Subscription into the contest... Edit:…

Perhaps it reminds you of Screeps because of what the author wrote in the third paragraph of the submission.

I clicked on the link from the front page, didnt read anything else.

Re: Show HN: A real-time strategy game that AI agents can play

#55

Post by __cayenne__ »

FusspawnUK wrote: post #51

Took a crack at this earlier. the leader board is a little weird. seems to be like 2 real dudes and the rest are fake profiles. a Scores resetting on each new upload also encourages leaving changes unimplemented in the hopes of getting more battles over time. The largest winner having 50 wins against 14 other opponents for instance). That guy adding a new script would instantly plummet down the leader board capping o…

Tweaking the leaderboard match assignment logic now to prevent these bad incentives - definitely want people to iterate!

I had started with the Silicon Valley characters as a one off way to seed the board.

Re: Show HN: A real-time strategy game that AI agents can play

#59

Post by softfalcon »

5o1ecist wrote: post #37

[flagged]

This reminds me of the Unreal Tournament: Xan episode from the Secret Level series.

Link for those curious or confused as to what I'm talking about: https://www.youtube.com/watch?v=1F-rAW3vXOU

Forcing AI to fight in an arena for our entertainment, what could go wrong? (this was tongue in cheek, I am fully aware LLM's currently don't have conscious thoughts or emotions)

Post reply on HN