Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Genie 3: A new frontier for world models

deepmind.google

Post reply on HN
Print view View original

501–510 of 512 posts

Re: Genie 3: A new frontier for world models

#501

Post by imadr »

gond wrote: post #486
imadr wrote: post #475

Earlier quoted context omitted.

Don't you think a sufficiently advanced model will end up emulating what normal 3D engines already do mathematically? At least for the rendering part, I don't see you can "compress" the meaning behind light interaction without ending up with a somewhat latent representation of the rendering equation

If I am not mistaken, we are already past that. The pixel, or token, gets probability-predicted in real time. The complete, shaded pixel, as you will, gets computed ‘at once’ instead of layers of simulation. That’s the LLM’s core mechanism. If the mechanism allows for predicting how the next pixel will look like, which includes the lighting equation, then there is no need anymore for a light simulation. Would also li…

The model has multiple layers which are basically a giant non-linear equation to predict the final shaded pixel, I don't see how it's inherently difference from a shader outputing a pixel "at once".

Correct me if I'm wrong, but I don't see how you can simulate a PBR pixel without doing ANY pbr computation whatsoever.

For example one could imagine a very simple program computing sin(x), or a giant multi-layered model that does the same, wouldn't it just be a latent, more-or-less compressed version of sin(x)?

Re: Genie 3: A new frontier for world models

#506

Post by dangerdaniel »

simianparrot wrote: post #479
mewpmewp2 wrote: post #454

Earlier quoted context omitted.

I would envision someone creative working together with Gen AI being able to do something awesome, rather than just saying "make me a GTA clone". But someone creative having a vision in their head and then just guiding AI to flesh out the assets, details, etc.

They will then learn the bitter lesson that convincing the GenAI to create something that brings your vision to life is impossible. It's a real talent to even be able to define for yourself what your vision is, and then to have artists achieve it visually in any medium is a process of back and forth between people with their own interpretations evolving the idea into something even better and cohesive. GenAI will nev…

You can just specify to a high degree and it will follow your instructions. You’re coping bro.

Re: Genie 3: A new frontier for world models

#507

Post by jimmySixDOF »

jimmySixDOF wrote: post #208

What gets me is the egocentric perspective it has naturally produced from its training data, where you have the perception of a 3D 6 degrees of freedom world space around you. Once it's running at 90 frames per second and working in a meshed geometry space, this will intersect with augmented virtual XR headsets, and the metaverse will become an interaction arena for working with artificial intelligence using our phys…

aaaannnnddddd ... it's happening:

https://x.com/bilawalsidhu/status/1954229425199034753

Re: Genie 3: A new frontier for world models

#508

Post by chrz »

dangerdaniel wrote: post #506
simianparrot wrote: post #479

Earlier quoted context omitted.

They will then learn the bitter lesson that convincing the GenAI to create something that brings your vision to life is impossible. It's a real talent to even be able to define for yourself what your vision is, and then to have artists achieve it visually in any medium is a process of back and forth between people with their own interpretations evolving the idea into something even better and cohesive. GenAI will nev…

You can just specify to a high degree and it will follow your instructions. You’re coping bro.

bro, how you could get the very precise and predictable editing bro that you have in a regular game engine bro. also bro, empty pretty world with nothing to do bro is lame bro

Re: Genie 3: A new frontier for world models

#509

Post by chrz »

echelon wrote: post #297
make3 wrote: post #277

Earlier quoted context omitted.

It wouldn't be surprising if a structured version of this with state cached per room for example could be used in a game. & you're basically seeing GPT-3 and saying it will never be used in any serious application.. the rate of improvement in their model is insane

Don't put the world state into the model. Use the model as a renderer of whatever objects the "engine" throws at it. Use the CPU and RAM for world state, then pass it off to the model to render. Regardless of how this is done, Unreal Engine with all of its bells and whistles is toast. That C++ pile of engineering won't outdo something this flexible.

Making it exactly what you want, make edits or follow some exact state is the whole freaking problem here

Re: Genie 3: A new frontier for world models

#510

Post by chrz »

dlivingston wrote: post #329
forrestthewoods wrote: post #238

Earlier quoted context omitted.

> this is a clear glimpse into the future. Not for video games it isn’t.

Unless and until state can be stored outside of the model. I for one would love a video game where you're playing in a psychedelic, dream-like fugue.

Unless you can change fundamental problem that it doesnt follow the state the way you want exactly
Post reply on HN