Earlier quoted context omitted.
I have, and it's terrible in exactly the way GP describes it. It won't talk to me about anything involving the word "president" or anything related to the US political system, even very procedural/hopefully uncontroversial questions such as "who appoints , and is the appointment confirmed in congress or not". That's only one example; it generally refuses so many things (and often even lies about "not being able to",…
Weird. I wonder if there are regional differences. It just provided a succinct answer to "who appoints the head of nasa? is the appointment confirmed in congress or not?"
Genie 2: A large-scale foundation world model
241–250 of 436 posts
Re: Genie 2: A large-scale foundation world model
#242It’s interesting to me that we continue to see such pressure on video and world generation, despite the fact that for years now we’ve gotten games and movies that have beautiful worlds filled with lousy, limited, poorly written stories. Star Wars movies have looked phenomenal for a decade, full of bland stories we’ve all heard a thousand times. Are there any game developers working on infinite story games? I don’t ca…
I think that's a bit of a trap. It's not impossible, but by default we should expect it to make games less fun . The better you make this infinite narrative generator, the more complicated the world gets and the less compelling it gets to actually interact with any one story. Stories thrive by setting their own context. They should feel important to the viewer. An open world with infinite stories can't make every sto…
- SimCity where you can read a newspaper about what's happening in your city that actually reflects the events that have occurred with interesting perspectives from the residents.
- Dwarf Fortress, but carvings, artwork, demons, forbidden beasts, etc get illustrations dynamically generated via stable diffusion (in the style of crude sketches to imply a dwarf made it perhaps?)
- Dwarf Fortress, again, but the elaborate in-game combat comes with a "narrative summary" which conveys first hand experiences of a unit in the combat log, which while detailed, can be otherwise hard to follow.
- Any fantasy RPG, but with a minstrel companion who follows you around and writes about what you do in a silly judgy way. The core dialogue could be baked in by the developers but the stories this minstrel writes could be dynamically generated based on the players actions. Example: "He was a whimsical one, who decided to take detour from his urgent hostage rescue mission to hop up and down several hundred times in the woods while trying on various hats he had collected. I have no idea what goes through this mans mind..."
I'm not sure if there is a word for it, but the kernel here is that everything is indirectly being dictated by the players actions and the games existing systems. The LLM/AI stuff isn't in charge of coming up with novel stories and core content, they are in charge of making the game more immersive by helping with the roleplay. I think this is the area they can thrive the most.
Re: Genie 2: A large-scale foundation world model
#243Earlier quoted context omitted.
If stories (and AAA games in general) are bland in games is due in large part to how expensive are to produce. Risk tolerance is low. If game assets are cheap to generate you’ll see small teams or even solo developers willing to take more creative risks
Counter point: you’d see a corresponding exponential increase in QA labor, and just like with the web, Steam will be absolutely flooded with slop. So I see the most likely outcome is a lot of dogshit and Steam being forced to make draconian moves to protect the integrity of the store.
I don’t see why AI will be any different. All that’s changed is ratio of potential creators to the general population. Most of it is going to be slop regardless because of economic incentives.
Re: Genie 2: A large-scale foundation world model
#244Earlier quoted context omitted.
The final step is an oversimplification: purpose-built simulator -> deconstructed robot on a lab workbench -> controlled space -> "real world" with constraints -> real world Any model would have to succeed in one stage before it can proceed to the next one.
At the risk of sounding repetitive, one of those arrows is not like the others.
Re: Genie 2: A large-scale foundation world model
#245Re: Genie 2: A large-scale foundation world model
#246Earlier quoted context omitted.
Yeah, generative AI can create cool looking pictures and video but so far it hasn't managed to create infinitely engaging stories. The models aren't there yet.
I'd argue that the same principle applies to pictures, there are many genres of AI image that are cool the first time you see them, but after you've seen the exactly the same idea rehashed dozens of times with no substantial variety it starts wearing really thin. AI imagery is often recognizable as AI not just because of charactistic flaws like garbled text but because it's so hyper-clichéd.
I haven't added any words or phrases to it in years, but I still use it regularly and somehow it still surprises me. Maybe the Spelunky-type approach can be surprising for longer; that is, make a bunch of hand-curated bits and pick from them randomly: https://tinysubversions.com/spelunkyGen/
Re: Genie 2: A large-scale foundation world model
#247Re: Genie 2: A large-scale foundation world model
#248Earlier quoted context omitted.
> the squealing carcass called Gemini Have you used Gemini? It seems every bit as good as ChatGPT.
I have, and it's terrible in exactly the way GP describes it. It won't talk to me about anything involving the word "president" or anything related to the US political system, even very procedural/hopefully uncontroversial questions such as "who appoints , and is the appointment confirmed in congress or not". That's only one example; it generally refuses so many things (and often even lies about "not being able to",…
Re: Genie 2: A large-scale foundation world model
#249What is actually of value here? There's no actual game, it's incredibly expensive to compute, the behavior is erratic.. It's cool because it's new - but that will quickly wear off, and once that's gone, what's left? There's insane amounts of money being spent on this, and for what?
Re: Genie 2: A large-scale foundation world model
#250This is.. super impressive. I'd like to know how large this model is. I note that the first thing they have it do is talk to agents who can control the world gen; geez - even robots get to play video games while we work. That said; I cannot find any: - architecture explanation - code - technical details - API access information Feels very DeepMind / 2015, and that's a bummer. I think the point of the "we have no moat…
Any estimates of how much one of these cost to generate and keep a minute of context? Secondly, any estimate of how much the price could fall in 5-10 years?
It's not clear if video models will follow the same trajectory.