AI video you can watch and interact with, in real-time
experience.odyssey.world
AI video you can watch and interact with, in real-time
1–10 of 91 posts
Re: AI video you can watch and interact with, in real-time
#2This is amazing! I think the AI will completely replace the way we create and consume media currently. A well written story, with an amazing graphics generation AI can be both interactive and surprising every time you watch it again.
Re: AI video you can watch and interact with, in real-time
#3Note that it isn't being created from whole cloth, it is trained on videos of the places and then it is generating the frames:
"To improve autoregressive stability for this research preview, what we’re sharing today can be considered a narrow distribution model: it's pre-trained on video of the world, and post-trained on video from a smaller set of places with dense coverage. The tradeoff of this post-training is that we lose some generality, but gain more stable, long-running autoregressive generation."
Re: AI video you can watch and interact with, in real-time
#4Well, that felt like entering a dream on my phone. Fuzzy virtual environments generated by "a mind" based on its memory of real environments...
I wonder if it'd break our brains more if the environment changes as the viewpoint changes, but doesn't change back (e.g. if there's a horse, you pan left, pan back right, and the horse is now a tiger).
Re: AI video you can watch and interact with, in real-time
#5Exploring babel’s library!
Re: AI video you can watch and interact with, in real-time
#6it’s super cool. I keep thinking it kind of feels like dream logic. It looks amazing at first but I’m not sure I’d want to stay in a world like that for too long. I actually like when things have limits. When the world pushes back a bit and gives you rules to work with.
Re: AI video you can watch and interact with, in real-time
#7Note that it isn't being created from whole cloth, it is trained on videos of the places and then it is generating the frames: "To improve autoregressive stability for this research preview, what we’re sharing today can be considered a narrow distribution model: it's pre-trained on video of the world, and post-trained on video from a smaller set of places with dense coverage. The tradeoff of this post-training is tha…
Could probably be (semi?)automated to run on 3d models of places that doesn't exist. Even ai-built 3d models.
Re: AI video you can watch and interact with, in real-time
#8This seems like a staggeringly inefficient way to develop what is essentially a FPS engine.
Re: AI video you can watch and interact with, in real-time
#9[flagged]
Re: AI video you can watch and interact with, in real-time
#10[flagged]
For sure, but consider it a "first draft" of what this type of generative AI can do.
The resolution is extremely low. The website doesn't specify, but I'd guess it's only 160x120. Such a low resolution was necessary to render it in real time and maintain a reasonable frame rate. To try to hide the blurring a bit, they apply some filters to add scan lines and other effects to make it look like an old TV.
That said, I'd be surprised if anybody could gather the hardware to work well enough to get it to a useable resolution, let alone even something like 1080p. It's literally over 100x the pixels of 160x120.