Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Project Genie: Experimenting with infinite, interactive worlds

blog.google

Post reply on HN
Print view View original

141–150 of 347 posts

Re: Project Genie: Experimenting with infinite, interactive worlds

#141

Post by jplusequalt »

echelon wrote: post #93
krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

The more I see of this, the faster I want it to go! I'm developing filmmaking tools with World Labs' Marble world model: https://www.youtube.com/watch?v=wJCJYdGdpHg https://github.com/storytold/artcraft I think we'll eventually get to the point where these are real time and have consistent representations. I've been excited about world models since I saw the in-the-browser Pokemon demo: https://madebyoll.in/posts/gam…

>I think we'll eventually get to the point where these are real time and have consistent representations

Just like how people in the 50s thought we would have flying cars and nuclear fusion by 2000.

Re: Project Genie: Experimenting with infinite, interactive worlds

#142

Post by phailhaus »

seedie wrote: post #56
phailhaus wrote: post #27

I have no idea why Google is wasting their time with this. Trying to hallucinate an entire world is a dead-end. There will never be enough predictability in the output for it to be cohesive in any meaningful way, by design. Why are they not training models to help write games instead? You wouldn't have to worry about permanence and consistency at all, since they would be enforced by the code, like all games today. Lo…

Imo they explain pretty well what they are trying to achieve with SIMA and Genie in the Google Deepmind Podcast[1]. They see it as the way to get to AGI by letting AI agents learn for themselves in simulated worlds. Kind of like how they let AlphaGo train for Go in an enormous amount of simulated games. [1] https://youtu.be/n5x6yXDj0uo

That makes even less sense, because an AI agent cannot learn effectively from a hallucinated world without internal consistency guarantees. It's an even stronger case for leveraging standard game engines instead.

Re: Project Genie: Experimenting with infinite, interactive worlds

#143

Post by jplusequalt »

boogrpants wrote: post #138
avaer wrote: post #86

Earlier quoted context omitted.

Or maybe it will just make people realize the value of fake life experiences and human relationships.

The American public is no different than an American corporation; trying to extract as much allegiance and loyalty as possible for as little compensation as possible. Your neighbors in the street protesting for comprehensive single payer healthcare? Yeah they're perfectly fine leaving your existence up to "market forces". Copy-paste office workers everywhere reciting memorized platitudes and compliance demands. You'r…

>I think we'll eventually get to the point where these are real time and have consistent representations

You have a dangerously low opinion of your fellow man, and while I sympathize with your frustration, I would humbly suggest you direct that anger at owners of companies/politicians, rather than aim it at your everyday citizen.

Re: Project Genie: Experimenting with infinite, interactive worlds

#144

Post by phailhaus »

dyauspitr wrote: post #77
phailhaus wrote: post #27

I have no idea why Google is wasting their time with this. Trying to hallucinate an entire world is a dead-end. There will never be enough predictability in the output for it to be cohesive in any meaningful way, by design. Why are they not training models to help write games instead? You wouldn't have to worry about permanence and consistency at all, since they would be enforced by the code, like all games today. Lo…

Why is it a dead end, you don’t meaningfully explain that. These models look like you can interact with them and they seem to replicate physics models.

They don't though, they're hallucinated videos. They're feeding models tons and tons of 2D videos and hoping they figure out physics from them, instead of just using a game engine and having the LLM write something up that works 100% of the time.

Re: Project Genie: Experimenting with infinite, interactive worlds

#145

Post by jplusequalt »

moomoo11 wrote: post #108
krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

I think this would be good for the people living in overcrowded, polluted and dirty cities in the world (let's be honest, they actually exist regardless of how that happened or why). Maybe they can unplug from 500+ AQI pollution and spend time with their loved ones and friends in a simulated clean world? Imagine working for 10-12 hours a day, and you come home to a pod (and a building could house thousands of pods, p…

There are posters in this very thread chain who want this reality to come to pass.

Re: Project Genie: Experimenting with infinite, interactive worlds

#146

Post by phailhaus »

godelski wrote: post #74
phailhaus wrote: post #27

I have no idea why Google is wasting their time with this. Trying to hallucinate an entire world is a dead-end. There will never be enough predictability in the output for it to be cohesive in any meaningful way, by design. Why are they not training models to help write games instead? You wouldn't have to worry about permanence and consistency at all, since they would be enforced by the code, like all games today. Lo…

> Why are they not training models to help write games instead? Genie isn't about making games... Granted, they for some reason they don't put this at the top. Classic Google, not communicating well... | It simulates physics and interactions for dynamic worlds, while its breakthrough consistency enables the simulation of any real-world scenario — from robotics and modelling animation and fiction, to exploring locatio…

But it's not simulating, is it? It's hallucinating videos with an input channel to guide what the video looks like. Why do that instead of just picking Unreal, Unity, etc and having it actually simulated for a fraction of the effort?

Re: Project Genie: Experimenting with infinite, interactive worlds

#147

Post by phailhaus »

anigbrowl wrote: post #127
phailhaus wrote: post #27

I have no idea why Google is wasting their time with this. Trying to hallucinate an entire world is a dead-end. There will never be enough predictability in the output for it to be cohesive in any meaningful way, by design. Why are they not training models to help write games instead? You wouldn't have to worry about permanence and consistency at all, since they would be enforced by the code, like all games today. Lo…

It's been very profitable for drug dealers for centuries, who wouldn't want a piece of that market?

Because games already exist, and it would be easier for LLMs to write games rather than hallucinate videos.

Re: Project Genie: Experimenting with infinite, interactive worlds

#149

Post by alex_c »

krunck wrote: post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

Ironically, this brings us one step closer to believing the simulation hypothesis might be true... In which case, maybe there is no real world anyway ;)

Re: Project Genie: Experimenting with infinite, interactive worlds

#150

Post by switchbak »

boogrpants wrote: post #138
avaer wrote: post #86

Earlier quoted context omitted.

Or maybe it will just make people realize the value of fake life experiences and human relationships.

The American public is no different than an American corporation; trying to extract as much allegiance and loyalty as possible for as little compensation as possible. Your neighbors in the street protesting for comprehensive single payer healthcare? Yeah they're perfectly fine leaving your existence up to "market forces". Copy-paste office workers everywhere reciting memorized platitudes and compliance demands. You'r…

Maybe some folks (ahem) disappearing into virtual worlds is a good thing for those left behind.
Post reply on HN