Why would anyone care that a big company paid for some people to go on an inhouse research excursion.
Real artists ship.
SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
61–70 of 115 posts
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#62Earlier quoted context omitted.
Isn't that what the voice a11y tools have been doing for years. Why do you need AI for that. https://support.google.com/accessibility/android/answer/6151... https://support.apple.com/en-us/111778
My friend that is AI. However, it can get a lot better: be more aware of screen content, follow multiple instructions at once, keep context in mind throughout the conversation and from past interactions
AI commonly means LLM. Where are you determining this is using a LLM for proccessing?
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#63Isn't most of this demo no man's sky? The voiceover doesn't make it clear that the world is not generated by SIMA.
If it can get through those lengthy glitchy nms story mission tutorials quickly it's already a super intelligence. as much as some AI annoys me. This would be great for making games more accessible.
I guess but, there is also a lot of data out there knowing how to do it, whether that’s via video training or reddit posts. I want to see the whole video
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#64I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
Personally, I think that if I need to delegate the grind, then the game is badly designed (or you are cheating)
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#65Earlier quoted context omitted.
My friend that is AI. However, it can get a lot better: be more aware of screen content, follow multiple instructions at once, keep context in mind throughout the conversation and from past interactions
AI commonly means LLM. Where are you determining this is using a LLM for proccessing?
AI has existed for several decades before the first LLM was ever created.[1][2][3]
And that's not even considering machine learning and deep learning which also have existed for many years before LLMs.
Even if you consider the current usage of the word AI in popular culture, it includes things that are not an LLM like Stable Diffusion and Suno
[1] https://en.wikipedia.org/wiki/Expert_system
[2] https://en.wikipedia.org/wiki/Deep_Blue_(chess_computer)
[3] https://en.wikipedia.org/wiki/Lisp_machine#Historical_contex...
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#66Earlier quoted context omitted.
sorry this is kind of nuts to me. You want something to play video games for you because the video game isn't fun? Just play a game that is fun. The point of the game is to play it
I mean, that's literally a RTS?
Except an RTS is designed around it
If the game needs to perform grind yourself, without delegating it (think Albion Online, Eve Online, Black Desert Online, Path of Exile etc. basically every MMO with economy), it means it's actively part of the game design, and delegating it to a robot is just cheating (and against the ToS in all of those cases)
So the point of GP's post, which I agree with, is that if that kind of grind is not part of the fun for you, then the game wasn't designed for you (and please don't cheat because you ruin other's fun)
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#67I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
[deleted]
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#68I want a smarter game.
Like a survival game that - as usual - starts with you collecting sticks and stone to build a stone axe. But at the appropriate tech level, transitions into automation.
You discovered a new building material and want to build a castle from it? Equip your NPC's with diamond pickaxes and tell them how much better/safer life would be if they built a new castle from unobtanium.
And off they go.
To not just mine it, but also do all the supporting logistics like farming to make food/shelter/watersupply/defences for more villagers to do more work in the quarry to get more unobtanium.
You get to be the big boss and flit around with your special abilities of whatever suits your story.
While some people on HN are the boss or higher up - getting to be the big boss and tell a bunch of "smart" characters what to do is a fantasy for most people.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#69I want a smarter game. Like a survival game that - as usual - starts with you collecting sticks and stone to build a stone axe. But at the appropriate tech level, transitions into automation. You discovered a new building material and want to build a castle from it? Equip your NPC's with diamond pickaxes and tell them how much better/safer life would be if they built a new castle from unobtanium . And off they go. To…
so you want to play The Sims?
Honestly, that's the perfect avenue for this kind of AI agent training / NPC to command. Maybe not playing house but like you said, mining unobtanium for your doomsday weapon. Just expect Sir Charles to start crying at the sight of blood.
Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds
#70OK, AI playing video games is cool. But you know what's really really cool? It looks like SIMA 2 is controlling the mouse and reading the screen at something approaching 30+fps. WANT. Computer use agents are so slow right now, this is really something. I wonder what the architecture is for this.
Is it though? A machine could play a game frame-by-frame.