StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
1–10 of 54 posts
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#2Interesting, outside of the academic merits of the research, I wonder if they could partner with Blizzard (or other similar RTS game studios) and start shipping games with AI that is very difficult to beat? That would usher in a new era of solo and offline game play that could be very fun and challenging! Plus we'd be training Skynet, err, I mean the neural network in the process!
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#3The thing with StarCraft is that there are many types of units and types of damage, you need to alternate between moving and attacking, different units have different roles in a formation, etc.
When I pick targets I prefer to kill units that deal the most damage or have low HP first.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#4I want an AI assisted mode with API hooks where people can code their own sophisticated "macros" that can be activated with a command/button. Limit the code to X number of characters. It would be awesome to see a tournament with this.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#5I want an AI assisted mode with API hooks where people can code their own sophisticated "macros" that can be activated with a command/button. Limit the code to X number of characters. It would be awesome to see a tournament with this.
There is some stuff like this, you would see it on the ladder in SC2. Hacks that would perfectly split your marines against incoming banelings (they explode and do splash damage so the more you split the less effective they were), or auto burrowing/unburrowing roaches (which hides them from the enemy and they heal underground). It sounds cool but it’s way cooler when you saw a pro doing all that stuff themselves almost as good and still going back and building units etc.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#6For those who don't know Starcraft: microing refers to the small scale/precise maneuvering of units during a battle, as well as activating special unit abilities at certain times. In the lower level leagues microing is not as important as having a good overall large-scale "macro" strategy. The microing really starts coming into play at the higher levels where it can give the edge needed to win a battle.
I am not very surprised that machine learning has been able to successfully execute micromanagement. In my opinion the macro decisions are more interesting, since they typically require higher level reasoning (and comprehension of what the opponent is doing). We have yet to see an AI system that can successfully execute macro strategy when playing against a human opponent.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#7I want an AI assisted mode with API hooks where people can code their own sophisticated "macros" that can be activated with a command/button. Limit the code to X number of characters. It would be awesome to see a tournament with this.
There is some stuff like this, you would see it on the ladder in SC2. Hacks that would perfectly split your marines against incoming banelings (they explode and do splash damage so the more you split the less effective they were), or auto burrowing/unburrowing roaches (which hides them from the enemy and they heal underground). It sounds cool but it’s way cooler when you saw a pro doing all that stuff themselves almo…
Check this out. 100 zerglings vs 20 siege tanks - https://www.youtube.com/watch?v=IKVFZ28ybQs
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#8Three great short videos showing an old StarCraft bot in action. I recommend watching #3 then #2. The second shows a pro player for comparison.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#9For those who don't know Starcraft: microing refers to the small scale/precise maneuvering of units during a battle, as well as activating special unit abilities at certain times. In the lower level leagues microing is not as important as having a good overall large-scale "macro" strategy. The microing really starts coming into play at the higher levels where it can give the edge needed to win a battle. I am not very…
How can this be so? In my experience playing Starcraft the decision space for macro is very, very, very limited. You are essentially locked into a handful of viable build orders for the early game, a handful of timing attack opportunities in the early and mid game, and after that things veer so off track that very few players do more than wing it.
Re: StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer
#10For those who don't know Starcraft: microing refers to the small scale/precise maneuvering of units during a battle, as well as activating special unit abilities at certain times. In the lower level leagues microing is not as important as having a good overall large-scale "macro" strategy. The microing really starts coming into play at the higher levels where it can give the edge needed to win a battle. I am not very…
I actually find the advanced micro to be far more interesting in the edge cases where you can break the game's balance system. I remember when the Brood War api first was released a while ago, there was an AI bot that won some competition with just mutalisks because the AI micro prevented them from overlapping their AOE hit boxes as they moved around. So you had mass mutalisks that the opponent couldn't use AOE against. It was able to effectively micro mutas against goliaths/corsairs/valkyries/etc.