Feels like the Mist (Myst?) game.
AI video you can watch and interact with, in real-time
81–90 of 91 posts
Re: AI video you can watch and interact with, in real-time
#82That felt so wrong AND someone is cheating here. This felt really suspicious... I got to the graffiti world and there were some stairs right next to me. So I started going up them. It felt like I was walking forward and the stairs were pushing under me until I just got stuck. So I turned to go back down and half way around everything morphed and I ended up back down at the ground level where I originally was. I was t…
I mean... https://news.ycombinator.com/item?id=44121671 informed you of exactly why this happens a whole hour before you posted this comment and the creator is chatting with people in the comments. I get that you feel personally cheated, but I really don't think anyone was deliberately trying to cheat you. In light of that, your comment (and i only say this because it's the top comment on this post) is effectively a…
> I mean... https://news.ycombinator.com/item?id=44121671 informed you of exactly why this happens a whole hour before you posted this comment and the creator is chatting with people in the comments.
> and the creator is chatting with people in the comments.
> is effectively a stereotypical "who needs dropbox" levels of shallow dismissal.
https://news.ycombinator.com/item?id=44147777
> and i only say this because it's the top comment on this post
Re: AI video you can watch and interact with, in real-time
#83I think this step towards a more immerse virtual reality can actually be dangerous. A lot of intellectual types might disagree but I do think that creating such immersion is a dangerous thing because it will reduce the value people place on the real world and especially the natural world, making them even less likely to care if big corporations screw it up with biospheric degradation. It seems like it has a high chan…
This is why we never see any alien life. When they reach a sufficient level of technology, they realize the virtual/mental universe is much more compelling and fun than the boring rule-bound physical one.
Actually, it's that the aliens eventually get completely immersed in technology to the point where they just self-destruct due to the meaninglessness of the life they have created.
Re: AI video you can watch and interact with, in real-time
#84I think this step towards a more immerse virtual reality can actually be dangerous. A lot of intellectual types might disagree but I do think that creating such immersion is a dangerous thing because it will reduce the value people place on the real world and especially the natural world, making them even less likely to care if big corporations screw it up with biospheric degradation. It seems like it has a high chan…
People were saying literally the exact same thing when those crappy VR headsets were all the rage. I think we're ok.
So your argument is that because it didn't work once, that it won't work now? At some point, a breakthrough is made and in this case the breakthrough is a bad one.
Re: AI video you can watch and interact with, in real-time
#85That felt so wrong AND someone is cheating here. This felt really suspicious... I got to the graffiti world and there were some stairs right next to me. So I started going up them. It felt like I was walking forward and the stairs were pushing under me until I just got stuck. So I turned to go back down and half way around everything morphed and I ended up back down at the ground level where I originally was. I was t…
Hi! CEO of Odyssey here. Thanks for giving this a shot. To clarify: this is a diffusion model trained on lots of video, that's learning realistic pixels and actions. This model takes in the prior video frame and a user action (e.g. move forward), with the model then generating a new video frame that resembles the intended action. This loop happens every ~40ms, so real-time. The reason you're seeing similar worlds wit…
Does it stores a model of the world (like, some memory of the 3d structure) that goes beyond the pixels that are shown?
Or is the next frame a function of just the previous frame and the user input? Like (previous frame, input) -> next frame
I'm asking because, if some world has two distinct locations that look exactly the same, will the AI distinguish them, or will they get coalesced into one location?
Re: AI video you can watch and interact with, in real-time
#86To me, this is evidence we're not in a simulation. Even with a gazillion H100's the model runs out of memory just (very roughly) simulating a 50'x50' space over just a few seconds.
Re: AI video you can watch and interact with, in real-time
#87Earlier quoted context omitted.
Great questions! > Why are you going all in on world models instead of basing everything on top of a 3D engine that could be manipulated / rendered with separate models? I absolutely think there's going to be super cool startups that accelerate film and game dev as it is today, inside existing 3D engines. Those workflows could be made much faster with generative models. That said, our belief is that model-imagined ex…
> Plus, you've got the very large challenge of learning a rich, high-quality 3D representation from a very small pool of 3D data. The volume of 3D data is just so small, compared to the volumes generative models really need to begin to shine. Isn’t the entire aim of world models (at least, in this particular case) to learn a very high quality 3D representation from 2D video data? My point is if that you manage to tra…
> wouldn’t that imply that you’re trying to converge on a physically accurate world model?
Re: AI video you can watch and interact with, in real-time
#88This seems like a staggeringly inefficient way to develop what is essentially a FPS engine.
Only at first glance. It can easily render things that would be very hard to implement in an FPS engine. What AI can dream up in milliseconds could take hundreds of human hours to encode using traditional tech (meshes, shaders, ray tracing, animation, logic scripts, etc.), and it still wouldn't look as natural and smooth as AI renderings — I refer to the latest developments in video synthesis like Google's Veo 3. Ima…
This thing looks like a complete joke next to the Unreal Engine.
Re: AI video you can watch and interact with, in real-time
#89I do not get the "interactive" part. I expect to be able to manipulate objects or at least move them, you know, "interact" with the "video". Now it is some cheap walking simulator, without narration or any plot. Disappearing lamp posts when you get near them also should not be considered an interaction.
Maybe you should take a bit different approach to interactive videos, and let's say build a tech review video for some gadget or device, where viewer could interrupt host, using voice, and ask them questions, skip to some part or repeat something in more detail, explain some concept, even compare to other devices.
Re: AI video you can watch and interact with, in real-time
#90Seems like it ingested google street view