Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI video you can watch and interact with, in real-time

experience.odyssey.world

Post reply on HN
Print view View original

31–40 of 91 posts

Re: AI video you can watch and interact with, in real-time

#31

Post by mvdtnz »

thetoon wrote: post #7
qingcharles wrote: post #3

Note that it isn't being created from whole cloth, it is trained on videos of the places and then it is generating the frames: "To improve autoregressive stability for this research preview, what we’re sharing today can be considered a narrow distribution model: it's pre-trained on video of the world, and post-trained on video from a smaller set of places with dense coverage. The tradeoff of this post-training is tha…

Could probably be (semi?)automated to run on 3d models of places that doesn't exist. Even ai-built 3d models.

What's the point? You already have the 3d models. If you want an interactive video just use the 3d models.

Re: AI video you can watch and interact with, in real-time

#32

Post by [deleted] »

xpl wrote: post #17
spzb wrote: post #8

This seems like a staggeringly inefficient way to develop what is essentially a FPS engine.

Only at first glance. It can easily render things that would be very hard to implement in an FPS engine. What AI can dream up in milliseconds could take hundreds of human hours to encode using traditional tech (meshes, shaders, ray tracing, animation, logic scripts, etc.), and it still wouldn't look as natural and smooth as AI renderings — I refer to the latest developments in video synthesis like Google's Veo 3. Ima…

[deleted]

Re: AI video you can watch and interact with, in real-time

#33

Post by [deleted] »

bufferoverflow wrote: post #30
godelski wrote: post #27

That felt so wrong AND someone is cheating here. This felt really suspicious... I got to the graffiti world and there were some stairs right next to me. So I started going up them. It felt like I was walking forward and the stairs were pushing under me until I just got stuck. So I turned to go back down and half way around everything morphed and I ended up back down at the ground level where I originally was. I was t…

Same. Got to the corner of the house, turned around, and got teleported back to the starting point. I call BS.

[deleted]

Re: AI video you can watch and interact with, in real-time

#34

Post by mvdtnz »

vouaobrasil wrote: post #22

I think this step towards a more immerse virtual reality can actually be dangerous. A lot of intellectual types might disagree but I do think that creating such immersion is a dangerous thing because it will reduce the value people place on the real world and especially the natural world, making them even less likely to care if big corporations screw it up with biospheric degradation. It seems like it has a high chan…

People were saying literally the exact same thing when those crappy VR headsets were all the rage. I think we're ok.

Re: AI video you can watch and interact with, in real-time

#35

Post by [deleted] »

mortenjorck wrote: post #24
netsharc wrote: post #4

Well, that felt like entering a dream on my phone. Fuzzy virtual environments generated by "a mind" based on its memory of real environments... I wonder if it'd break our brains more if the environment changes as the viewpoint changes, but doesn't change back (e.g. if there's a horse, you pan left, pan back right, and the horse is now a tiger).

I kept expecting that to happen, but it apparently has some mechanism to persist context outside the user’s FOV. In a way, that almost makes it more dreamlike, in that you have what feels like high local coherence (just enough not to immediately tip you off that it’s a dream) that de-coheres over time as you move through it. Fascinatingly strange demo.

[deleted]

Re: AI video you can watch and interact with, in real-time

#36

Post by magnat »

godelski wrote: post #27

That felt so wrong AND someone is cheating here. This felt really suspicious... I got to the graffiti world and there were some stairs right next to me. So I started going up them. It felt like I was walking forward and the stairs were pushing under me until I just got stuck. So I turned to go back down and half way around everything morphed and I ended up back down at the ground level where I originally was. I was t…

It feels like an interpolated Street View imagery. There is one scene with two people between cars in a parking lot. It is the only one I have found that has objects you would expect to change over time. When exploring the scene, those people sometimes disappear altogether and sometimes teleport around, as they would when exploring Street View panoramas. You can clearly tell when you are switching between photos taken a few seconds apart.

Re: AI video you can watch and interact with, in real-time

#38

Post by AnotherGoodName »

AnotherGoodName wrote: post #28
godelski wrote: post #27

That felt so wrong AND someone is cheating here. This felt really suspicious... I got to the graffiti world and there were some stairs right next to me. So I started going up them. It felt like I was walking forward and the stairs were pushing under me until I just got stuck. So I turned to go back down and half way around everything morphed and I ended up back down at the ground level where I originally was. I was t…

Yes the thing that got me was i went through the channels multiple times (multiple browser sessions). The channels are the same everytime (the numbers don't align to any navigation though - flip back and forth between two numbers and you'll just hit a random channel everytime - don't be fooled by that). Every object is in the same position and the layout is the same. What makes this AI generated over just rendering a…

Ok playing with this more there's very subtle differences between sessions. As in there is some hallucination here with certain small differences.

I think what's happening is this is AI generated but it is very very overfitted to real world 3D scenes. The AI is almost rendering exactly a real world scene and not much more. They can't travel out of bounds or the model stops working since it's so overfitted to these scenes. The overfitting solves hallucinations but it also makes it almost indistinguishable from pre modelled 3D scenes.

Post reply on HN