81–90 of 115 posts
Earlier quoted context omitted.
To be fair, it's 65% on all tasks (with a 75% human baseline) and 15% on unseen environments. They don't provide a human baseline for that, but I'd imagine it's much more than 15%.
It really feels like we are determined to simulate every possible task in every possible environment instead of building true intelligence.
Tangential question: is this going to eventually ruin e-sports? What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective... And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired? Eventually it could kill all MMOs, fill them up with AI players,…
For the video game market in general, AI will be used by players largely where there are financial incentives (MMO market, CS:GO Skins, etc.), but usage of an AI will most often be socially viewed just like usage of any other performance improvement/script/hack: As a crutch.
OK, AI playing video games is cool. But you know what's really really cool? It looks like SIMA 2 is controlling the mouse and reading the screen at something approaching 30+fps. WANT. Computer use agents are so slow right now, this is really something. I wonder what the architecture is for this.
[1] https://en.wikipedia.org/wiki/The_Lifecycle_of_Software_Obje...
I hope we can get some (ideally local) version of this we can use as a "gaming minion". There's a lot of games where I probably would have played more if I could delegate the grind. If they're not that competent, it adds to the fun a little even.
"Wow! I could've sworn I was really playing virtual Skeeball!"
--
In practice I think you would lose interest very quickly in any game should you do so. Games are carefully designed to balance the drudgery with action, and to control the complexity progression. Using AI would break both.
OK, AI playing video games is cool. But you know what's really really cool? It looks like SIMA 2 is controlling the mouse and reading the screen at something approaching 30+fps. WANT. Computer use agents are so slow right now, this is really something. I wonder what the architecture is for this.
Its even cooler if humans find something to be excited about in this world, since AI is replacing everything we do.
I want a smarter game. Like a survival game that - as usual - starts with you collecting sticks and stone to build a stone axe. But at the appropriate tech level, transitions into automation. You discovered a new building material and want to build a castle from it? Equip your NPC's with diamond pickaxes and tell them how much better/safer life would be if they built a new castle from unobtanium . And off they go. To…
It's an open-source framework for building intelligent, task-driven bots in Minecraft Java Edition powered by large language models (LLMs) such as GPT-4, Gemini, and many others. Designed for research and creative automation, these bots can connect to Minecraft worlds, perceive and act on their environment, undertake custom tasks like resource gathering or building, and even collaborate in multi-agent scenarios.
Tangential question: is this going to eventually ruin e-sports? What happens when a team of humans are playing against a team of AI, which play in the same conditions, with network lag etc. from a client computer perspective... And consistently beat the human counterparts for being faster at response time, never make mistakes and not ever getting tired? Eventually it could kill all MMOs, fill them up with AI players,…
games like CS its less useful because it will be blatantly aimbotting. as it gets better it will be more and more obvious. you might be able to train it to mimick human mistakes, but i think ultimately it will be easily spotted by other players. for games without the hand-eye-coordination like turn-based games or games with 'global cooldowns' , mmorpgs etc., it will be much harder to identify.
i think normal subtle cheats like ESP when 'done right' are much more killing esports than this would.
Earlier quoted context omitted.
My friend that is AI. However, it can get a lot better: be more aware of screen content, follow multiple instructions at once, keep context in mind throughout the conversation and from past interactions
AI commonly means LLM. Where are you determining this is using a LLM for proccessing?
Earlier quoted context omitted.
Its even cooler if humans find something to be excited about in this world, since AI is replacing everything we do.
You do realise the things that AI are replacing are very new things humans have only been doing for the last ~50 years?