Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Project Genie: Experimenting with infinite, interactive worlds

blog.google

Post reply on HN
Print view View original

221–230 of 347 posts

Re: Project Genie: Experimenting with infinite, interactive worlds

#221

Post by llmthrow0827 »

ollin wrote: post #28

Really great to see this released! Some interesting videos from early-access users: - https://youtu.be/15KtGNgpVnE?si=rgQ0PSRniRGcvN31&t=197 walking through various cities - https://x.com/fofrAI/status/2016936855607136506 helicopter / flight sim - https://x.com/venturetwins/status/2016919922727850333 space station, https://x.com/venturetwins/status/2016920340602278368 Dunkin' Donuts - https://youtu.be/lALGud1Ynhc?si=…

These are extremely impressive from a technological progression standpoint, and at the same time not at all compelling, in the same way AI images and LLM prose are and are not.

It's neat I guess that I can use a few words and generate the equivalent of an Unreal 5 asset flip and play around in it. Also I will never do that, much less pay some ongoing compute cost for each second I'm doing it.

Re: Project Genie: Experimenting with infinite, interactive worlds

#222

Post by consumer451 »

Related:

> Diego Rivas, Shlomi Fruchter, and Jack Parker-Holder from the Project Genie team join host Logan Kilpatrick for an in-depth discussion on Google DeepMind’s latest breakthrough in world models. Project Genie is an experimental research prototype that allows users to generate, explore, and interact with infinitely diverse, photorealistic worlds in real-time. Learn more about the shift from passive video generation to interactive media, the technical challenges of maintaining world consistency and memory, and how these models serve as an essential training ground for AI agents.

https://www.youtube.com/watch?v=Ow0W3WlJxRY

Re: Project Genie: Experimenting with infinite, interactive worlds

#223

Post by qingcharles »

speak_on wrote: post #123

Compared to DeepMind's Genie 3 demo, this appears to have more morphing issues and less user interactivity with environmental consistency. Is this a stripped down version?

Yes. Some features were removed from the version demoed last year.

Re: Project Genie: Experimenting with infinite, interactive worlds

#224

Post by isodev »

krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

Same here. The moment we see the person with the keyboard on the video it suddenly becomes kind of painful to watch. All these scenes generated from actual footage someone made… it’s also kind of sad.

Re: Project Genie: Experimenting with infinite, interactive worlds

#225

Post by qingcharles »

bpiche wrote: post #131

This is the plot of The Peripheral, right? Love the way the second half of that book turned out. Never finished Agency..

Agency was great. I read it when it came out and never realized until a couple of weeks ago that it was a sequel to The Peripheral.

Re: Project Genie: Experimenting with infinite, interactive worlds

#226

Post by qingcharles »

cpeth wrote: post #137
RivieraKid wrote: post #14

This would be really cool if polished and integrated with VR.

Exactly this, it would essentially be a STTNG Holodeck

The engineers said in an interview today that full reality simulation is their goal, aka holodeck.

Re: Project Genie: Experimenting with infinite, interactive worlds

#227

Post by isodev »

TacoCommander wrote: post #105
krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

After a lifetime career in tech, I want to turn it all off.

I used to think the only really essential component of a home is to have internet. It’s 20 years later, and I feel anything can be a home as long as it gets regular paper mail every couple of days.

Re: Project Genie: Experimenting with infinite, interactive worlds

#228

Post by qingcharles »

HardCodedBias wrote: post #49
cloudflare728 wrote: post #44

We will probably see Ready Player One in a few decades. Hoping to stay alive till then.

Decades? I mean, yes, the probability of having that level of tech in decades is quite high. But the technology is moving very fast right now. It sounds crazy, but I think that there is a 50% chance of having ready player one level technology before 2030. It's absolutely possible it will take more time to become economical.

Right. This thing has come light years in two years and money is pouring into the space now. Never mind the sheer amount of competition that is driving innovation in world simulation. Just within a couple of years this thing will be wild.

Re: Project Genie: Experimenting with infinite, interactive worlds

#229

Post by magospietato »

tracerbulletx wrote: post #198
jlhawn wrote: post #167

Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…

I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.

Always wondered if dreaming is some kind of daily memory consolidation function. Logged short-term/episodic memory being filtered and the important bits baked by replaying in a limited simulacrum.

Re: Project Genie: Experimenting with infinite, interactive worlds

#230

Post by magospietato »

avaer wrote: post #63
in-silico wrote: post #52

Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.

Soft disagree; if you wanted imagination you don't need to make a video model. You probably don't need to decode the latents at all. That seems pretty far from information-theoretic optimality, the kind that you want in a good+fast AI model making decisions. The whole reason for LLMs inferencing human-processable text, and "world models" inferencing human-interactive video, is precisely so that humans can connect in…

I wonder what training insights could be gained by having proven general intelligences actively navigate a generative world model?
Post reply on HN