Live data from Hacker News

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

nvlabs.github.io

61–70 of 162 posts

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#61
Nice, now instead of just reading slop you'll soon be able to experience slop Worlds, in 3D! /s

It's honestly impressive, on the surface. The visuals are gorgeous... but it's still empty. What makes a "World" a world is precisely it's coherency. It's not about how it looks but rather how it "works". The plants in an ecosystems are a certain way because of the available resources, all the way to forces like gravity. It doesn't just "look" like that. To echo Konrad Lorenz a fish doesn't just swim in the water, rather the fish IS an efficient representation of the water it lives within. Here in such "worlds" there is nothing happening. There is minimal superficial coherence, no logic, nothing.

The ultimate liminal spaces.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#62

Has anyone actually tested this for robotics simulation? Curious how it handles edge cases in physical environments.

Judging by the examples it wouldn't be useful for that, the environments show little physical consistency.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#63
post #16

I struggle with these world models from the perspective of video games (so this post is a particular perspective). I'm not a game developer myself, but some of my favorite games carry a deep sense of intentionality. For instance, there is typically not a single item misplaced in a FromSoftware game (or, for instance, Lies of P -- more recently). Almost every object is placed intentionally. Games which lack this inten…

One thing is robotics. Both for training robotics AI, and to let robots test hypothetical actions before comitting to them. I don't think world models are stable enough for either yet

The other is creating multi-modal models with a better understanding of our world. LLMs often fail at incredibly basic spatial reasoning ("someone left a package in front of your apartment, describe going there", or the "should I drive to the car wash or go there", etc). World models excel at these kinds of things (in theory). They develop a great understanding of physical spaces, object interactions, etc. They can simulate fluids, rigid body physics etc. You "just" have to get really good at making world models, then somehow marry them with an LLM in a way that ensures the LLM can benefit from the world model's training data. Nobody has managed to really do that yet

So lots of hopes for the future. Until then they get commercialized as video models, or ways to experience your favorite forest, or to have a really bad video game ... whatever can be sold on a short time horizon to finance the actual goals

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#64

Earlier quoted context omitted.

Games. Build campaigns in hours instead of months. Make it possible for users to create their own campaigns, move the action to different game worlds - 'gimme Mario Kart in the ${favourite_game} world', etc.

Yeah, but is this really that great? Are these models going to remember the town you wandered through on your session yesterday and want to return to? Imagine playing Read Dead Redemption 2 and you attempt to ride your horse from Saint Denis to Valentine and Valentine no longer exists, or is a completely different town located half a mile off from where it was originally. I just don't see how this would work...

If I had to use the models as they exist right now I'd use them in a procedural Myst-like where I incorporate the temporal inconsistency into the setting. The player's actions and state would affect the prompts used for conditioning the video generation. It would probably be weird and buggy but could be fun.

You could also use these models to generate assets for a game during development whether that's simple cutscenes or assets produced through gaussian splatting or some other process.

If these models and others can be run cost effectively on a cloud service or even locally at some point then you could do some interesting things by combining them with 3D mesh generation, img2img, vid2vid, etc. just think about even simple games like Papers Please and the whole genre it spawned that uses short episodes where you have to make a guess based on what you see, there's a lot of potential for creating new mechanics around generative imagery.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#65

All video models are terrible at consistency. Even closed source ones. Seedance 2.0, Kling 3 are regarded the best closed source video models we have. I have subscribed to a few AI video subreddits, consensus atm is they are good for anything but long form videos with humans. No surprises that we're very good at spotting even the most subtle differences while looking at other people.

what subreddits do _you_ subscribe to?

I've been doing some content with people at https://industrialallusions.com

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#66

First video with the guy walking the mountain in snow has consistency issues with the cave entrance. Which is "expected" at this model size?!

All of the videos have rather glaring consistency issues when direction shifts back to areas previously shown.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#67

What’s the long term utility of world models? There’s no doubt they’re technically impressive, but what does one do with it?

The world model is useful for planning. It can "anticipate" consequences of actions. This can be used for a kind of tree search to decide on optimal actions in robotics

[deleted]

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#68
post #65

All video models are terrible at consistency. Even closed source ones. Seedance 2.0, Kling 3 are regarded the best closed source video models we have. I have subscribed to a few AI video subreddits, consensus atm is they are good for anything but long form videos with humans. No surprises that we're very good at spotting even the most subtle differences while looking at other people.

what subreddits do _you_ subscribe to? I've been doing some content with people at https://industrialallusions.com

https://www.reddit.com/r/KlingAI_Videos/

https://www.reddit.com/r/HiggsfieldAI/

Higgsfield have multiple models available, people use Kling usually 2.5 & 3. There are a few good examples posted right now you'll notice the subtle differences.

I have tried to generate things myself and it's extremely hard to have more than 7-8 clips that are consistent, eventually you'll accept a compromise. I think it's why there isn't any long form content being done yet. Getting good results is sometimes just "chance" regardless of how many reference data you have.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#69

What’s the long term utility of world models? There’s no doubt they’re technically impressive, but what does one do with it?

World models will be how general purpose robots finally work. They are essentially learned simulators of the world. They will replace traditional robotics simulators which are not flexible enough to enable training of general robotics policies. Robot control policies will be trained and evaluated in learned simulators, and the policies themselves will also be world models in order to predict the consequences of their own actions and thus enable planning. Simulated data will scale much better than expensive real-world robot data, and will allow robot policies to reach LLM-level dataset sizes, and subsequently, LLM-level performance.

It is inevitable that learned simulators will replace hand-coded simulators, as it is a straightforward application of the Bitter Lesson: http://www.incompleteideas.net/IncIdeas/BitterLesson.html

By enabling general purpose robotics, world models will be one of the most useful inventions of all time. For examples of what I'm talking about in current research, check:

Dreamer 4: https://danijar.com/project/dreamer4/

DreamDojo: https://arxiv.org/abs/2602.06949

Tesla's world model: https://www.youtube.com/watch?v=LFh9GAzHg1c

Waymo's world model: https://waymo.com/blog/2026/02/the-waymo-world-model-a-new-f...

Post reply on HN