Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

deepmind.google

Post reply on HN
Print view View original

71–80 of 115 posts

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#71

Post by keyle »

Tangential question: is this going to eventually ruin e-sports?

What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective...

And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired?

Eventually it could kill all MMOs, fill them up with AI players, "farm" with AI that never sleeps, ruin counter strike type games online, etc. Another arms race?

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#72

Post by ElSucioDan »

keyle wrote: post #71

Tangential question: is this going to eventually ruin e-sports? What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective... And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired? Eventually it could kill all MMOs, fill them up with AI players,…

I wouldn’t think so. Chess already has an e-sport component and remains enjoyable even though computers have been stronger than humans for quite some time. I expect something similar here: we’ll know the computers are better, but it won’t diminish our enjoyment the way it might when it’s strictly human versus human.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#73

Post by gs17 »

efficax wrote: post #28
gs17 wrote: post #22

I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.

sorry this is kind of nuts to me. You want something to play video games for you because the video game isn't fun? Just play a game that is fun. The point of the game is to play it

>You want something to play video games for you

Sorry if it was unclear, but I want something that can act like a dumb co-op partner for games obviously balanced around co-op play so I can have fun playing the game. I've run into a few games like that and I end up dropping them when solo play is too tedious.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#74

Post by waltbosz »

_carbyau_ wrote: post #68

I want a smarter game. Like a survival game that - as usual - starts with you collecting sticks and stone to build a stone axe. But at the appropriate tech level, transitions into automation. You discovered a new building material and want to build a castle from it? Equip your NPC's with diamond pickaxes and tell them how much better/safer life would be if they built a new castle from unobtanium . And off they go. To…

Your comment makes me wonder how well SIMA 2 could do at playing Minecraft and discovering how create things like iron farms and villager trading halls.

Think of all the steps required for it to learn iron farms. First it would need to observe that iron golems drop iron when killed. Then it would need to learn about water physics. Then spawning rules for iron golems. Then how hoppers and chests work. Etc etc.

But would it even bother to learn it in the first place? To be motivated to build one it would need to first learn that iron is valuable. And if its goal is to simply win the game, it would probably skip right to fighting the ender dragon as soon as possible.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#75

Post by _carbyau_ »

reactordev wrote: post #69
_carbyau_ wrote: post #68

I want a smarter game. Like a survival game that - as usual - starts with you collecting sticks and stone to build a stone axe. But at the appropriate tech level, transitions into automation. You discovered a new building material and want to build a castle from it? Equip your NPC's with diamond pickaxes and tell them how much better/safer life would be if they built a new castle from unobtanium . And off they go. To…

so you want to play The Sims? Honestly, that's the perfect avenue for this kind of AI agent training / NPC to command. Maybe not playing house but like you said, mining unobtanium for your doomsday weapon. Just expect Sir Charles to start crying at the sight of blood.

The Sims was a great idea in a sandbox. I honestly hoped it would lead to other games having more intelligent/immersive NPCs.

I want my silver-spooned Sir Charles to cry at the sight of blood and be beheaded by Gazza, the self made, born-of-the-streets gang boss who has an arrangement with Prince Harry, the younger brother.

I then want to be able to challenge Gazza, take his criminal gang and rule the underworld of "Fantasy Kingdom XYZ". Perhaps "come to an understanding" with King Harry, maybe work my way up to spymaster and orchestrate neighbouring kingdoms to go to war with each other via a series of covert operations leaving selective evidence - say like the Princess Bride story but the bad guys(me!) win. Or maybe I don't win because I create a nemesis or fail to keep King Harry in check, get my gang wiped out, and have to seek a new way to the top.

I don't want the Sims obviously. But I want something... more than what we have now. Like the Sims mixed with Dwarf fortress but I get to be part of the story and influence it in outsized ways.

Edit: snipped to keep to a point, I did mention that most every game quest is based on violence.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#76

Post by reactordev »

_carbyau_ wrote: post #75
reactordev wrote: post #69

Earlier quoted context omitted.

so you want to play The Sims? Honestly, that's the perfect avenue for this kind of AI agent training / NPC to command. Maybe not playing house but like you said, mining unobtanium for your doomsday weapon. Just expect Sir Charles to start crying at the sight of blood.

The Sims was a great idea in a sandbox. I honestly hoped it would lead to other games having more intelligent/immersive NPCs. I want my silver-spooned Sir Charles to cry at the sight of blood and be beheaded by Gazza, the self made, born-of-the-streets gang boss who has an arrangement with Prince Harry, the younger brother. I then want to be able to challenge Gazza, take his criminal gang and rule the underworld of "…

I once forced my D&D group to solve all encounters without violence. Something about blood temple needing sacrifice to reawaken scared them into performing prestidigitations for 12 hours.

I’m with you. The vast majority of the spend on games is in the art and marketing and pennies spent on the story, arcs, quests, and it almost never coincides with the gameplay.

Take The Witcher 3. Dialog heavy, good story, but surely there are other witchers across the lands. Do you have to save everyone, all the time?

The MMO quests are the fucking worst. “Oh noes, boars in the woods” (1,000 boars are spawned just 100vft away) - Quest: Kill 10 boars. Reality: 240 noobs killing boars like it’s the boarpocolypse.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#77

Post by Vegenoid »

golol wrote: post #6

The gap between high level and low level control of robots is closing. Right now thousands of hours of task specific training data is being collected and trained on to create models that can control robots to execute specific tasks in specific contexts. This essentially turns the operation of a robot into a kind of video game, where inputs are only needed a in low-dimensional abstract form, such as "empty the dishwas…

> This essentially turns the operation of a robot into a kind of video game, where inputs are only needed a in low-dimensional abstract form, such as "empty the dishwasher" or "repeat what I do" or "put your finger in the loop and pull the string"

I don't really understand, how is this like a video game? What about these inputs is "low-dimensional"? How does what you describe interact with a "high-level control agents like SIMA 2"? Doesn't SIMA 2 translate inputs like "empty the dishwasher" into key presses or interaction with some other direct control interface?

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#78

Post by dyauspitr »

tantalor wrote: post #47
Workaccount2 wrote: post #45

Earlier quoted context omitted.

I desperately want an AI agent that can use my phone for me. Just something that takes instructs for each screen and execute it. "Open Chrome" "Go to xyz.com" "open hamburger menu" "Click login" etc. etc.

Isn't that what the voice a11y tools have been doing for years. Why do you need AI for that. https://support.google.com/accessibility/android/answer/6151... https://support.apple.com/en-us/111778

That’s all programmatic, you can’t throw curve balls at it.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#79

Post by dyauspitr »

keyle wrote: post #71

Tangential question: is this going to eventually ruin e-sports? What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective... And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired? Eventually it could kill all MMOs, fill them up with AI players,…

It will probably kill all MMO‘s just like online poker has been pretty much ruined.

Re: SIMA 2: An agent that plays, reasons, and learns with you in virtual 3D worlds

#80

Post by dyauspitr »

ElSucioDan wrote: post #72
keyle wrote: post #71

Tangential question: is this going to eventually ruin e-sports? What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective... And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired? Eventually it could kill all MMOs, fill them up with AI players,…

I wouldn’t think so. Chess already has an e-sport component and remains enjoyable even though computers have been stronger than humans for quite some time. I expect something similar here: we’ll know the computers are better, but it won’t diminish our enjoyment the way it might when it’s strictly human versus human.

Yeah, but that’s why chess is strictly played in person for most high-level events. We don’t really have highly reliable online games for chess.
Post reply on HN