Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Project Genie: Experimenting with infinite, interactive worlds

blog.google

Post reply on HN
Print view View original

101–110 of 347 posts

Re: Project Genie: Experimenting with infinite, interactive worlds

#101

Post by echelon »

in-silico wrote: post #98
echelon wrote: post #88

Earlier quoted context omitted.

Whoa, whoa, whoa. That's just one angle. Please don't bin that as the only use case for "world models"! First of all, there are a variety of different types of world models. Simulation, video, static asset, etc. It's a loaded term, just as the use cases are widespread. There are world models you can play in your browser inferred entirely by your CPU: https://madebyoll.in/posts/game_emulation_via_dnn/ (my favorite, fr…

The entertainment industry, as big as it is, just doesn't have as much profit potential as robots and AI agents that can replace human labor. Just look at how Nvidia has pivoted from gaming and rendering to AI. The other examples you've given are neat, but for players like Google they are mostly an afterthought.

Robotics: $88B TAM

Gaming: $350B TAM

All media and entertainment: $3T TAM

Manufacturing: $5T TAM

Roughly the same story.

This tech is going to revolutionize "films" and gaming. The entire entertainment industry is going to transform around it.

When people aren't buying physical things, they're distracting themselves with media. Humans spend more time and money on that than anything else. Machines or otherwise.

AI impact on manufacturing will be huge. AI impact on media and entertainment will be huge. And these world models can be developed in a way that you develop exposure and competency for both domains.

edit: You can argue that manufacturing will boom when we have robotics that generalize. But you can also argue that entertainment will boom when we have holodecks people can step into.

Re: Project Genie: Experimenting with infinite, interactive worlds

#102

Post by reactordev »

in-silico wrote: post #52

Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.

Still cool though…

Re: Project Genie: Experimenting with infinite, interactive worlds

#103

Post by elfly »

MillionOClock wrote: post #60
phailhaus wrote: post #27

I have no idea why Google is wasting their time with this. Trying to hallucinate an entire world is a dead-end. There will never be enough predictability in the output for it to be cohesive in any meaningful way, by design. Why are they not training models to help write games instead? You wouldn't have to worry about permanence and consistency at all, since they would be enforced by the code, like all games today. Lo…

An hybrid approach could maybe work, have a more or less standard game engine for coherence and use this kind of generative AI more or less as a short term rendering and physics sim engine.

I've thought about this same idea but it probably gets very complicated.

Let's say, you simulate a long museum hallway with some vases in it. Who holds what? The basic game engine has the geometry, but once the player pushes it and moves it, it needs to inform the engine it did, and then to draw the next frame, read from the engine first, update the position in the video feed, then again feed it back to the engine.

What happens if the state diverges. Who wins? If the AI wins then...why have the engine at all?

It is possible but then who controls physics. The engine? or the AI? The AI could have a different understanding of the details of the base. What happens if the vase has water inside? who simulates that? what happens if the AI decides to break the vase? who simulates the AI.

I don't doubt that some sort of scratchpad to keep track of stuff in game would be useful, but I suspect the researchers are expecting the AI to keep track of everything in its own "head" cause that's the most flexible solution.

Re: Project Genie: Experimenting with infinite, interactive worlds

#106

Post by slashdave »

in-silico wrote: post #52

Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.

This is a video model, not a world model. Start learning on this, and cascading errors will inevitably creep into all downstream products.

You cannot invent data.

Re: Project Genie: Experimenting with infinite, interactive worlds

#107

Post by pizzafeelsright »

in-silico wrote: post #52

Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.

Environment mapping to AI generated alternative outcomes is the holodeck.

I prefer real danger as living in the simulation is derivative.

Re: Project Genie: Experimenting with infinite, interactive worlds

#108

Post by moomoo11 »

krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

I think this would be good for the people living in overcrowded, polluted and dirty cities in the world (let's be honest, they actually exist regardless of how that happened or why).

Maybe they can unplug from 500+ AQI pollution and spend time with their loved ones and friends in a simulated clean world?

Imagine working for 10-12 hours a day, and you come home to a pod (and a building could house thousands of pods, paid for by the company) where you plug in and relax for a few hours. Maybe a few more decades of breakthroughs can lead to simulated sleep as well so they get a full rest.

Wake up, head to the factory to make whatever the developed world needs.

(holy fuck that is a horrible existence but you know some people would LOVE for that to be real)

Re: Project Genie: Experimenting with infinite, interactive worlds

#110

Post by slashdave »

krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

Huh, yeah, the sky is blue outside and the sun is shining.

Although, I am feeling a bit lazy so let me see if I can simulate a walk.

Post reply on HN