Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Genie 2: A large-scale foundation world model

deepmind.google

Post reply on HN
Print view View original

111–120 of 436 posts

Re: Genie 2: A large-scale foundation world model

#111

Post by echelon »

CaptainFever wrote: post #110

As a game developer, I'm impressed and thinking of ideas of what to do with this kind of tech. The sailboat example was my favourite. Depending on how controllable the tech ends up being, I suppose. Could be anywhere from a gimmick (which is still nice) to a game engine replacement.

You could compress down a game to run on cheap hardware acceleration. No more Unreal Engine with crazy requirements. Once the hallucinations are fixed, you even get better lighting.

This is the Unreal Engine killer. Give it five years.

Re: Genie 2: A large-scale foundation world model

#112

Post by [deleted] »

suddenlybananas wrote: post #107
golol wrote: post #104

Earlier quoted context omitted.

Do you want household androids? Because this kind of stuff is on the level of research a bery large step towards that. Think as it as ab example where we can make a model understand a lot of physical common sense stuff, which is the goal for robotics right now.

This is really not the avenue for house-hold robots. Interacting with the actual physical world is very different from creating a video game.

[deleted]

Re: Genie 2: A large-scale foundation world model

#113

Post by 0x1ceb00da »

sergiotapia wrote: post #38

Will the GPU go the way of the soundcard, and we will all purchase an "LPU"? Language Processing Unit for AIs to run fast? I remember there was a brief window where some gamers bought a Physx card for high fidelity physics in games. Ultimately they rolled that tech in to the CPUs themselves right?

The graphics stuff in modern gpus is just a software layer on top of a generic processing unit. The name is a misnomer.

Re: Genie 2: A large-scale foundation world model

#114

Post by danans »

jjice wrote: post #2

I don't understand this space very well, but this seems incredible. Something I find interesting about generative AI is how it adds a huge layer of flexibility, but at the cost of lots of computation, while a very narrow set of constraints (a traditional program) is comparatively incredibly efficient. If someone spent a ton of time building out something simple in Unity, they could get the same thing running with a s…

> I assume that concrete code will always be faster and the best way to have deterministic results, but I really have to idea how to conceptualize what the future looks like now.

It will likely be a mix of both concrete code and live AI generated experiences, but even the concrete code will likely be partially AI generated and modified. The ratio will depend on how reliable vs creative the software needs to be.

For example, no AI generated code running pacemakers or power plants. But game world experiences could easily be made more dynamic by generative AI.

Re: Genie 2: A large-scale foundation world model

#115

Post by pfortuny »

psb217 wrote: post #86
simonw wrote: post #13

Related recent project you can try out yourself (Chrome only) which hallucinates new frames of a Minecraft style game: https://oasis.decart.ai/ That one would reimagine the world any time you look at the sky or ground. Sounds like Genie2 solves that: "Genie 2 is capable of remembering parts of the world that are no longer in view and then rendering them accurately when they become observable again."

RE: "Genie 2 is capable of remembering parts of the world that are no longer in view and then rendering them accurately when they become observable again." -- This claim is almost certainly wildly misleading. This claim is technically true if there's any scenario where their agent, eg, briefly looked down at the ground and then back up at the sky and at least one of the clouds in the sky was the same as before lookin…

"remember parts of the world..." not even "some"... That is a tell-tale.

Re: Genie 2: A large-scale foundation world model

#116

Post by psb217 »

jeroenvlek wrote: post #59
uoaei wrote: post #31

Earlier quoted context omitted.

Pixelspace is an awful place to be generating 3D assets and maintaining physical self-consistency.

Ultimately even conventional 3d assets are rendered into pixelspace. It all comes down to the constraints in the model itself.

A key strength of conventional 3d assets is that their form is independent of the scenes in which they will be rendered. Models that work purely in pixel space avoid the constraints imposed by representing assets in a fixed format, but they have to do substantial extra work to even approximate the consistency and recomposability of conventional 3d assets. It's unclear whether current approaches to building and training purely pixel-based models will be able to achieve a practically useful balance between their greater flexibility and higher costs. World Labs, for example, seems to be betting that an intermediate point of generating worlds in a flexible but structured format (NERFs, gauss splats, etc) may produce practical value more quickly than going straight for full freedom and working in pixel space.

Re: Genie 2: A large-scale foundation world model

#118

Post by lassenordahl »

nightski wrote: post #101
ilaksh wrote: post #95

Earlier quoted context omitted.

It's an obviously amazing research development. You just don't like AI. It can be used for training agents, prototyping, video generation, and is quite possibly a glimpse of a whole new type of entertainment or a new way to create video games. What's the point of the massive amount of money spent on video games in general? Or all of the energy spent moving people back and forth to an office? Or expensive meals at res…

Video games bring billions of real people joy. This is sitting in some lab at Google inaccessible to anyone.

Is your argument that them sharing research progress and demos doesn't benefit anybody purely because we can't immediately play around with them?

I feel like sharing early closed-source blog-posts is part of the research process. I'm sure someone in this thread has thought of a use case that the Google team missed. Open/closed source arguments here feel premature IMO.

Re: Genie 2: A large-scale foundation world model

#119

Post by mosdl »

tigerlily wrote: post #92
phtrivier wrote: post #82

Earlier quoted context omitted.

I don't understand your line of reasoning here. Are you picturing a situation where you would take a photo of a crime scene, and "jump" into a virtual model created from the photo, to help generate intuitions about where to go look for clues ? Kinda like the CSI "enhance quality" meme, but on steroids ? That would be fun to use, but ultimately pointless. An AI model will generate things that are _statistically plausi…

You nailed it, and yes I was being lamely ironic. I am however terrified of a future where this type of thing happens, and people just go along with it instead of stating the obvious facts the way you just did.

Remake Blade Runner but with the twist that the snake scale was never actually there.

Re: Genie 2: A large-scale foundation world model

#120

Post by Const-me »

The scrolling doesn’t work in my MS Edge so I opened the page in Firefox. Firefox has “Open Video in New Tab” context menu command. When viewed that way, the videos are not that impressive. Horrible visual quality, Egyptian pyramids of random shapes which cast round shadows, etc.

I have a feeling many AI researchers are trying to fix things which are not broken.

Game engines are not broken, no reasonable amount of AI TFlops going to approach a professional with UE5. DAWs are not broken, no reasonable amount of AI TFlops going to approach a professional with Steinberg Cubase and Apple Logic.

I wonder why so many AI researchers are trying to generate the complete output with their models, as opposed to training model to generate some intermediate representation and/or realtime commands for industry-standard software?

Post reply on HN