Live data from Hacker News

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

nvlabs.github.io

1–10 of 162 posts

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#6
The trouble is the lack of training available to these models compared to the ones like Seedance and Kling who seems to be tapping into their unlimited video inventory. Many models like LTX is technically good but when it comes to slightly different camera movements or the subject interacting with objects they struggle. For a recent example we had to use sample videos generated by closed source models and then use the same for final video.

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#7

So, where is the download? I can't find it on Github, and on your web page the download button is disabled. Also, will this run on RTX 4090 with 24GB memory? Thank you!

Scroll down and there are more videos --- seems like models will be there "soon".

Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video

#8
post #6

The trouble is the lack of training available to these models compared to the ones like Seedance and Kling who seems to be tapping into their unlimited video inventory. Many models like LTX is technically good but when it comes to slightly different camera movements or the subject interacting with objects they struggle. For a recent example we had to use sample videos generated by closed source models and then use th…

I tend to think of these NV Labs models as architectural demos and ‘free razor blades’ — they’re more intended to inform internal R&D, get customers something that lets them do what they want quickly, and enhance the state of the art.

In this case, what looks interesting is the one minute coherence and the massive speedup - they claim 36x over open models with similar capabilities. You can tell they aren’t aiming for state of the art visuals — looks very SD 1.5 in terms of the output quality.

Post reply on HN