Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Genie 2: A large-scale foundation world model

deepmind.google

Post reply on HN
Print view View original

121–130 of 436 posts

Re: Genie 2: A large-scale foundation world model

#121

Post by ThouYS »

ogogmad wrote: post #102
ThouYS wrote: post #98

Earlier quoted context omitted.

same q here. what can I do with this "world model" that I can't do with a game like minecraft or counter strike? asked the same thing a while back, and the answers boiled down to "somehow helps RL agents train". but how exactly? no clue

Making a computer game is very expensive and time-consuming. This technology might allow a 12 year old to produce a fully working AAA-quality game on their own for almost nothing. But sigh it's an early demo that needs some improving. [edited out some barbs I wrote because I find some comments on this website REALLY annoying]

lol

Re: Genie 2: A large-scale foundation world model

#123

Post by qwertox »

This is... something different. It will be interesting to see how we will integrate our current 3D tooling into that prompt-based world. Sometimes a "place a button next to the the door" isn't the same as selecting a button and then clicking on the place next to the door, as it is today, or to sculpt a terrain with a brush, all heavily 3D oriented operations, involving transformation matrix calculations, while that promt-based world is build through words.

The current tooling we have is just way too good to just discard it, think of Maya, Blender and the like. How will these interfaces, with the tools they already provide, enable sculpting these word-based worlds?

I wonder if some kind of translator will be required, one which precisely instructs "User holds a brush pointing 33° upwards and 56° to the left of the world's x-axis with a brush consisting of ... applied with a strength of ...", or how this will be translated into embeddings or whatever that will be required to communicate with that engine.

This is probably the most exciting time for the CG industry in decades, and this means a lot, since we've been seeing incredible progress in every area of traditional CG generation. Also a scary time for those who learned the skills and will now occasionally see some random persons doing incredible visuals with zero knowledge of the entire CG pipeline.

Re: Genie 2: A large-scale foundation world model

#124

Post by Retric »

golol wrote: post #103
Retric wrote: post #7

Earlier quoted context omitted.

Longer term computation isn’t really the limiting factor for generative AI, it’s training data. Generative AI is like Google search before the web responded to their search engine existing. There’s a huge quantity of high quality training data which nobody had any reason to pollute ready for the scrapping. But modern search is hampered by people responding to algorithmic indexes. Algorithms responding to metadata wit…

I disagree. With more computation you can train a bigger model on the same size training data and it will be better. There is a lot if knowledge on the internet that GPT-4 etc. have not yet learned.

The issue is the training data isn’t some constant. Let’s suppose OpenAI had 10x the computing power but a vastly worse dataset, do you expect a better or worse result?

The question is ambiguous without defining how much worse the dataset is.

Re: Genie 2: A large-scale foundation world model

#125

Post by sangnoir »

suddenlybananas wrote: post #107
golol wrote: post #104

Earlier quoted context omitted.

Do you want household androids? Because this kind of stuff is on the level of research a bery large step towards that. Think as it as ab example where we can make a model understand a lot of physical common sense stuff, which is the goal for robotics right now.

This is really not the avenue for house-hold robots. Interacting with the actual physical world is very different from creating a video game.

> Interacting with the actual physical world is very different from creating a video game

The major difference being the former scales very poorly for generating training data compared to the latter. Genie 2 is not even a video game and has worse fidelity that video games, the upside is it probably scales even better than video games for generating training scenarios. If you want androids in teal life, Genie 2 (or similar systems) is how you bootstrap the agent AI. The training pipeline will be: raw video -> Genie 2 -> game engine with rules -> physical robot

Re: Genie 2: A large-scale foundation world model

#126

Post by noch »

echelon wrote: post #111
CaptainFever wrote: post #110

As a game developer, I'm impressed and thinking of ideas of what to do with this kind of tech. The sailboat example was my favourite. Depending on how controllable the tech ends up being, I suppose. Could be anywhere from a gimmick (which is still nice) to a game engine replacement.

You could compress down a game to run on cheap hardware acceleration. No more Unreal Engine with crazy requirements. Once the hallucinations are fixed, you even get better lighting. This is the Unreal Engine killer. Give it five years.

> This is the Unreal Engine killer. Give it five years.

We need to calm down with the clickbait-addled thinking that "this new thing kills this established powerful tested useful thing." :-)

Game developers have been discussing these tools at length, after all, they are the group of software developers who are most motivated to improve their workflow. No other group of software developers comes close to gamedevs' efficiency requirements.

The 1 thing required for serious developers is control. As such, game engines like Unreal and in-house engines won't die.

Generative tools will instead open up a whole new, but quite different, way of creating interactive media and games. Those who need maximum control over every frame and every millisecond and CPU cyle will still use engines. The rest who don't will be productive with generative tools.

Re: Genie 2: A large-scale foundation world model

#127

Post by freedryk »

Forget video games. This is a huge step forward for AGI and Robotics. There's a lot of evidence from Neurobiology that we must be running something like this in our brains--things like optical illusions, the editing out of our visual blind spot, the relatively low bandwidth measured in neural signals from our senses to our brain, hallucinations, our ability to visualize 3d shapes, to dream. This is the start of adding all those abilities to our machines. Low bandwidth telepresence rigs. Subatomic VR environments synthesized from particle accelerator data. Glasses that make the world 20% more pleasant to look at. Schizophrenic automobiles. One day a power surge is going to fry your doorbell camera and it'll start tripping balls.

Re: Genie 2: A large-scale foundation world model

#128

Post by erulabs »

It’s interesting to me that we continue to see such pressure on video and world generation, despite the fact that for years now we’ve gotten games and movies that have beautiful worlds filled with lousy, limited, poorly written stories. Star Wars movies have looked phenomenal for a decade, full of bland stories we’ve all heard a thousand times.

Are there any game developers working on infinite story games? I don’t care if it looks like Minecraft, I want a Minecraft that tells intriguing stories with infinite quest generation. Procedural infinite world gen recharged gaming, where is the procedural infinite story generation?

Still, awesome demo. I imagine by the time my kids are in their prime video game age (another 5 years or so) we will be in a new golden age of interactive story telling.

Hey siri, tell me the epic of Gilgamesh over 40 hours of gameplay set 50,000 years in the future where genetic engineering has become trivial and Enkidu is a child’s creation.

Re: Genie 2: A large-scale foundation world model

#129

Post by pmayrgundter »

freedryk wrote: post #127

Forget video games. This is a huge step forward for AGI and Robotics. There's a lot of evidence from Neurobiology that we must be running something like this in our brains--things like optical illusions, the editing out of our visual blind spot, the relatively low bandwidth measured in neural signals from our senses to our brain, hallucinations, our ability to visualize 3d shapes, to dream. This is the start of addin…

I can't wait for Schizophrenic automobiles
Post reply on HN