They all look like video games. I guess Unreal Engine is used to create synthetic data for training.
[deleted]
SANA-WM, a 2.6B open-source world model for 1-minute 720p video
21–30 of 162 posts
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#22I struggle with these world models from the perspective of video games (so this post is a particular perspective). I'm not a game developer myself, but some of my favorite games carry a deep sense of intentionality. For instance, there is typically not a single item misplaced in a FromSoftware game (or, for instance, Lies of P -- more recently). Almost every object is placed intentionally. Games which lack this inten…
[deleted]
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#23First video with the guy walking the mountain in snow has consistency issues with the cave entrance. Which is "expected" at this model size?!
My dreams have it too, which is unexpected at that model size!
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#24I struggle with these world models from the perspective of video games (so this post is a particular perspective). I'm not a game developer myself, but some of my favorite games carry a deep sense of intentionality. For instance, there is typically not a single item misplaced in a FromSoftware game (or, for instance, Lies of P -- more recently). Almost every object is placed intentionally. Games which lack this inten…
By and large I agree, but it doesn’t need to be either/or.
Many of the most popular games in the past decade are procedurally generated and have nothing “intentionally” placed (apart from tuning/tweaking the balance of the seeding algorithms).
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#25Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#26It ain’t open source until it’s released.
It’s baitware.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#27What’s the long term utility of world models? There’s no doubt they’re technically impressive, but what does one do with it?
Games. Build campaigns in hours instead of months. Make it possible for users to create their own campaigns, move the action to different game worlds - 'gimme Mario Kart in the ${favourite_game} world', etc.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#28All video models are terrible at consistency. Even closed source ones.
Seedance 2.0, Kling 3 are regarded the best closed source video models we have. I have subscribed to a few AI video subreddits, consensus atm is they are good for anything but long form videos with humans.
No surprises that we're very good at spotting even the most subtle differences while looking at other people.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#29[flagged]
Bot comment.
Re: SANA-WM, a 2.6B open-source world model for 1-minute 720p video
#30I struggle with these world models from the perspective of video games (so this post is a particular perspective). I'm not a game developer myself, but some of my favorite games carry a deep sense of intentionality. For instance, there is typically not a single item misplaced in a FromSoftware game (or, for instance, Lies of P -- more recently). Almost every object is placed intentionally. Games which lack this inten…
By and large I agree, but it doesn’t need to be either/or. Many of the most popular games in the past decade are procedurally generated and have nothing “intentionally” placed (apart from tuning/tweaking the balance of the seeding algorithms).
Right, and I wondered how these world models might be use in a careful way (just as agents can be used carefully to accelerate work).
Are video game developers using these systems in their workflows? Would love to learn more!