Would be cool to see if they could make it play starcraft too and pit it against alphastar.
I'm almost 100% confident AlphaStar would win that match, but I'd love to watch it.
SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
21–30 of 115 posts
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#22I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#23[deleted]
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#24Yet another blogpost that looks super impressive, until you get to the bottom and see the charts assessing held out task performance on ASKA and MineDojo and see that it's still a paltry 15% success rate. (Holy misleading chart batman!) Yes, it's a major improvement over SIMA 1, but we are still a long way from this being useful for most people.
To be fair, it's 65% on all tasks (with a 75% human baseline) and 15% on unseen environments. They don't provide a human baseline for that, but I'd imagine it's much more than 15%.
It really feels like we are determined to simulate every possible task in every possible environment instead of building true intelligence.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#25I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
I would love Minecraft with more intelligent villagers I could boss around to mine and build for me.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#26Would be cool to see if they could make it play starcraft too and pit it against alphastar.
From what I see, SIMA only focuses on games where you control a single avatar from a 1st/3rd person perspective, and would assume that switching to a non-embodied game where you need to control the whole army at once would require significant retraining.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#27Earlier quoted context omitted.
To be fair, it's 65% on all tasks (with a 75% human baseline) and 15% on unseen environments. They don't provide a human baseline for that, but I'd imagine it's much more than 15%.
It really feels like we are determined to simulate every possible task in every possible environment instead of building true intelligence.
I personally am extremely impressed about it reaching 15% on unseen environments. Note that just this year, we were surprised that LLMs became capable of making any progress whatsoever in GBA Pokemon games (that have significantly simpler worlds and control schemes).
As for "true intelligence" - I honestly don't think that there is such a thing. We humans have brains that are wired based on our ancestors evolving for billions of years "in every possible environment", and then with that in place, each individual human still needs quite a few years of statistical learning (and guided learning) to be able to function independently.
Obviously I'm not claiming that SIMA 2 is as intelligent as a human, or even that it's on the way there, but based on recent progress, I would be very surprised if we don't see humanoid robots using a approaches inspired by this navigate our streets in a decade or so.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#28I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
sorry this is kind of nuts to me. You want something to play video games for you because the video game isn't fun? Just play a game that is fun. The point of the game is to play it
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#29I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
Agree. It would be cool to populate my Valheim server with a bunch of agents that are in competition.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#30I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
sorry this is kind of nuts to me. You want something to play video games for you because the video game isn't fun? Just play a game that is fun. The point of the game is to play it
It could be fun in a factorio sense. Maybe the whole game becomes to delegate a bunch of smart robots and handle organization etc.