I tried watching the cave video and I was immediately overcome with nausea. I've never experienced anything like that before in my life. Wild.
I can't say I'm looking forward to an AI video future.
SANA-WM, a 2.6B open-source world model for 1-minute 720p video
71–80 of 162 posts
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#72I struggle with these world models from the perspective of video games (so this post is a particular perspective). I'm not a game developer myself, but some of my favorite games carry a deep sense of intentionality. For instance, there is typically not a single item misplaced in a FromSoftware game (or, for instance, Lies of P -- more recently). Almost every object is placed intentionally. Games which lack this inten…
>We are able to create less satisfying, less humane experiences faster? Yes, exactly. Inundate the world with superficially plausible yet hollow content, including any desired themes. People who aren't very discerning won't complain; the others will be outmatched and find that 99/100 pieces are all noise and they will need to spend increasing amounts of time trying to find the 1, if they can. I think there are some g…
I think you also can create satisfying, same human experiences faster, but not as fast.
But the dopamine descent require strong discipline to stop there, and most don't .
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#73warning: viewing the videos that auto play on that page shot up my downloads to 350Mbps on that page
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#74Model weights coming "soon" == currently vaporware. So the weights aren't even open, how can this be "open-source"? Everyone is right to be skeptical of this coming from a 2.8B model. Weights or it didn't happen.
Clearly it's not open in that case. I wonder if we can get the title changed?
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#75[deleted]
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#76So, where is the download? I can't find it on Github, and on your web page the download button is disabled. Also, will this run on RTX 4090 with 24GB memory? Thank you!
> SANA-WM uses only ~213K public video clips with metric-scale pose supervision, completes training in 15 days on 64 H100s, and generates each 60-second clip on a single GPU; its distilled variant runs on a single RTX 5090 with NVFP4 quantization to denoise a 60s 720p clip in 34s.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#77Earlier quoted context omitted.
Games. Build campaigns in hours instead of months. Make it possible for users to create their own campaigns, move the action to different game worlds - 'gimme Mario Kart in the ${favourite_game} world', etc.
Yeah, but is this really that great? Are these models going to remember the town you wandered through on your session yesterday and want to return to? Imagine playing Read Dead Redemption 2 and you attempt to ride your horse from Saint Denis to Valentine and Valentine no longer exists, or is a completely different town located half a mile off from where it was originally. I just don't see how this would work...
Same prompt, same seed, and yes you can ensure you get the same output, but also imagine using it as a game designer and recording the output. Imagine level editors where you prompt to fill in details, walk through it, decide which parts you don't like, and prompt for a replacement of those parts.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#78What’s the long term utility of world models? There’s no doubt they’re technically impressive, but what does one do with it?
Right now there is (AFAIK) no world model product booking any meaningful revenue. So there's a decent chance WMs turn out to have no long-term utility at all.
However, there are a few promising markets, assuming WMs continue to get better and cheaper:
1. Robotics training / evaluation: modern end-to-end (sensors-to-control) robot policies require simulators that are almost indistinguishable from reality. If your sim is distinguishable from reality, the evaluation metrics you get from sim don't mean anything and the policies you train in sim don't work. World models will likely be the highest-fidelity robotics simulators, since WMs are data-driven and get arbitrarily more-realistic given more data/compute. This is why so many robotics companies have WM projects [1] [2] [3] [4].
2. Video frontends for agents: in the same way that today's frontier labs are building realtime voice interfaces [5] which behave like a phone call, realtime video interfaces will behave like a video call. Early forms of this don't feel compelling IMO [6] [7], but once the models can instantly blend between rendering the agent itself, drawing diagrams/visualizations, rendering video, etc. I can see it surpassing pure voice mode.
3. Entertainment: zero-shot world generation (i.e. holodeck, genie 3; paste in an image/video/text prompt and get a world) will be a fun toy but I'm not convinced it has any long-term value. I'm more optimistic about proper narrative experiences where each scene/level is a small, carefully-crafted world (behaving like a normal film scene if you don't touch the controls, and an uncharted/TLoU-style narrative game if you do), such that the sequence of scenes builds up a larger story.
[1] https://wayve.ai/thinking/gaia-3/
[2] https://xcancel.com/Tesla/status/1982255564974641628 / https://xcancel.com/ProfKuang/status/1996642397204394179
[3] https://waymo.com/blog/2026/02/the-waymo-world-model-a-new-f...
[4] https://www.1x.tech/discover/world-model-self-learning
[5] https://thinkingmachines.ai/blog/interaction-models/
[6] https://runwayml.com/news/introducing-runway-characters
[7] https://blog.character.ai/character-ais-real-time-video-brea...
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#79warning: viewing the videos that auto play on that page shot up my downloads to 350Mbps on that page
I only noticed after more than an hour with the page left open in a tab. Is it really streaming and re-streaming the same videos? There's too much to cache so it keeps re-transferring them indefinitely?
I hope nobody leaves that page open on a metered or capped network connection.
I'm surprised github hasn't suspended the page.
Are AI researchers so used to burning through compute and network resources that they don't stop to think about a webpage that will autoplay and loop multiple HD videos?