Live data from Hacker News

Project Genie: Experimenting with infinite, interactive worlds

blog.google

241–250 of 347 posts

Re: Project Genie: Experimenting with infinite, interactive worlds

#241
post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

I love AI but I also hope it will paradoxically make people realize the value of real life experiences and human relationships.

Like what happened with the Internet. Oh wait no it didn't happen. Yea...

Re: Project Genie: Experimenting with infinite, interactive worlds

#242
Prediction: In true Google fashion they will never spend enough time on this really cool tech demo to make it really useful in any way.

In 6-12 months they will announce another really cool tech demo. And so on.

They have been doing this for decades. To us this seems like the starting point of something really cool. To them it's a delivery; finally time to move on to something else.

Re: Project Genie: Experimenting with infinite, interactive worlds

#243

Earlier quoted context omitted.

I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.

Always wondered if dreaming is some kind of daily memory consolidation function. Logged short-term/episodic memory being filtered and the important bits baked by replaying in a limited simulacrum.

There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.

Re: Project Genie: Experimenting with infinite, interactive worlds

#244
post #167

Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…

Another analogy that kinda fits in with what you're saying is the post-processing on smartphone "photos." At what point does the processing become so strong that it's less a photograph and more a work of computational impressionism?

At the point where Samsung detects a photo of a white circle while the phone is pointing upwards and substitutes a high resolution picture of the moon.

This actually happened.

Re: Project Genie: Experimenting with infinite, interactive worlds

#245

Anyone else going to try it and just keep getting a 404 page?

It came up for me and accepted a photo, but it has just been stuck in the "Don't go anywhere, it's almost ready" state for 10+ minutes.

No idea how long it is supposed to take. They can pull a 3D world out of thin air but they apparently can't vibe-code a progress bar...

Edit: Now it's saying "We'll notify you when it's ready, and you'll have 30 seconds to enter your world. You are 37th in the queue." Go to restroom, come back 1 minute later: "The time to enter your world ran out." Lame-o.

Re: Project Genie: Experimenting with infinite, interactive worlds

#246

Earlier quoted context omitted.

Ironically the physics are kind of my biggest criticism. They call these "world models", but I think it's more accurate to call them "video game models" because they employ "video game physics" rather than real world physics, among other things This is most evident in the way things collide.

It's getting better staggeringly fast, just a year ago I wouldn't expect it to be at even video game physics level so quickly. If there is a possibility where it continue to improve at a similar rate with llms. A way to simulate fluid dynamics or structural dynamics with reasonable accuracy and speed can unlock much faster pace of innovation in the physical world. (And validated with rigorous scientific methods)

Numerical simulation is a well explored field, we know how to do all sorts of things, the issues lie rather in the tooling and robustness of it all put together (from geometry to numerical results) than in conceptual barriers. Finite Differences have existed since the 1700's! What hadn't for the longest time, is the computational power to crunch billions of operations per simulation.

A nice thing about numerical simulation from first principles, is it innately supports arbitrary speed/precision, that's in fact the backbone of the mathematical analysis for why it works.

In some cases, as is the case for CFD, we're actually mathematically screwed because you just have to resolve the small scales to get the macro dynamics. So the standard remains a kind of hack, which is to introduce additional equations (turbulence models) that steer the dynamics in place of the small (unresolved) scales. We know how to do better though (DNS), but it costs an arm and a leg (like years to milenia on a super computer).

Re: Project Genie: Experimenting with infinite, interactive worlds

#247
post #167

Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…

Yeah, this kind of thing was part of the subject of my PhD, first postdoc, and ongoing scientific work. The question is how to produce generative models and inverse-inference algorithms that are powerful enough to work in tens to hundreds of milliseconds in high dimensionality :-/

Re: Project Genie: Experimenting with infinite, interactive worlds

#248

Earlier quoted context omitted.

Yeah and the goal of Instagram was to share quirky pictures you took with your friends. Now it’s a platform for influencers and brainrot; arguably it has done more damage than drugs to younger generations. As soon as this thing is hooked up to VR and reaches a tipping point with the general public we all know exactly what is going to happen. The creation of the most profitable, addictive and ultimately dystopian tech…

The good news is we’ll finally have an answer for the Fermi Paradox.

wait ... how?

Re: Project Genie: Experimenting with infinite, interactive worlds

#249
post #79

Earlier quoted context omitted.

That’s part of it but if you could actually pull out 3D models from these worlds, it would massively speed up game development.

You already can, check out Marble/World Labs, Meshy, and others. It's not really as much of a boon as you'd think though, since throwing together a 3D model is not the bottleneck to making a sellable video game. You've had model marketplaces for a long time now.

It definitely is. Model marketplaces don’t have ready to go custom models for a custom game. You have to pay a real person a significant amount of money for 100s of a models a truly custom game requires.

Re: Project Genie: Experimenting with infinite, interactive worlds

#250
post #46

The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.

Huh, yeah, the sky is blue outside and the sun is shining. Although, I am feeling a bit lazy so let me see if I can simulate a walk.

Will join you in a bit, let me just pause the simulation to adjust the settings for "knee pain when walking" and "need coffee to jump start day"
Post reply on HN