How fast can it generate a frame? If its fast enough for real time then you wouldn't need to pipe the outputs to a different novel view synthesis method like Gaussian splats.
Atlas: A World Model for Spatial Intelligence
31–40 of 64 posts
Re: Atlas: A World Model for Spatial Intelligence
#32This is incredible. One potential application that I'm thinking about already is the rapid iteration of video-game map blocking. Being able to drop in some 'initial state' configuration and then have it procedurally generate a handful of alternative configurations could make rapid prototyping a significantly quicker experience, especially if you wanted to see what a potential end result could look like. Furthermore,…
Yeah where I've been previously skeptical for using AI in creative ways, basically when these tools get to the point where you have a tight iteration loop, it enables a great creative flow.
You still need the technical proficiency to be able to make edits beyond that, but I think studios would be foolish to let go of their experts in the first place.
Re: Atlas: A World Model for Spatial Intelligence
#33Any ideas if it keeps continuity - when you turn around, is the invented chair still there, or does everything shift like in a dream?
I believe so. This is not a model that generates pixels frame by frame from user input like genie 3. Instead, there’s an actual 3D scene / structure generated (point cloud, 3dgs) from the input images.
Wrong, it does go straight to generating images.
Re: Atlas: A World Model for Spatial Intelligence
#34"Can reconstruct [scenes from Unreal Engine]"
Synthetic training data is easier to acquire
Re: Atlas: A World Model for Spatial Intelligence
#35It's a promising approach - and the demo goes to show just how advanced and robust "3D from 2D" reconstruction is now.
Dedicated depth sensors used to be a must on advanced robotics platforms - the only way to get anything close to reliable 3D point clouds was to spin a LiDAR. But by now, I wouldn't be surprised to see more and more robots ship with smartphone-like camera blocks - varying FoVs and focal depths, but not a lot of explicit depth sensing, if any at all.
Also, I wonder if this very model can be retrofit into a true robotics VLA? If it already takes text and image guidance, performs autoregressive diffusion of novel views, and handles temporal dynamics - why not diffusion of actions too?
Re: Atlas: A World Model for Spatial Intelligence
#36The blog post doesn't seem to mention what strikes me as the most interesting application of a model like this, namely extracting semantic information from its latent space. It mentions robotics applications, but only in the context of generating realistic world models for simulation. If you have a robot deployed in an environment, generating synthetic views of the environment you're in doesn't have any obvious value…
What is the scenario you're thinking about? This is kinda what happens with VLAs, the latent knowledge of an LLM can help in action generation pipelines, but it's also kinda slow.
Re: Atlas: A World Model for Spatial Intelligence
#37I'm a cofounder at World Labs - happy to answer questions about Atlas!
Are y'all using any sort of self-distillation similar to https://self-evo.github.io/ to sharpen representations?
Re: Atlas: A World Model for Spatial Intelligence
#38Earlier quoted context omitted.
spacial context feature is cool - what are the limitations, if any? What would it take to geo and rotation tag every photo ever taken , combine it into a mass spatial context, run it through atlas and build an entire 3D model of the world?
Atlas project lead here. Atlas is an auto-regressive diffusion model, so context length limitations apply similar to LLMs and video models. Where Atlas has an edge is that its context comprised of an arbitrary sequence of images with camera poses, which lends itself to managing the context in creative ways (we called this "context juggling" in our RTFM blog, https://www.worldlabs.ai/blog/rtfm ). So yes through clever…
Would it be more reasonable to take images from movies and create worlds of various IPs?
My first thought is a detailed Hogwarts that is fully explorable using scenes from the movies (or even descriptions from the books?)
Re: Atlas: A World Model for Spatial Intelligence
#39The blog post doesn't seem to mention what strikes me as the most interesting application of a model like this, namely extracting semantic information from its latent space. It mentions robotics applications, but only in the context of generating realistic world models for simulation. If you have a robot deployed in an environment, generating synthetic views of the environment you're in doesn't have any obvious value…
As a World Labs customer, I suspect they are using existing 3D assets when creating their environments. For one thing, a vendor of 3d models for AI mentioned Word Labs as a customer on a webinar.
I don't know if that undercuts what you're saying entirely. But if they're just protecting the splat in real-time based on the camera path through a 3d world, would the model truly understand that it's a floor?
Re: Atlas: A World Model for Spatial Intelligence
#40I'm a cofounder at World Labs - happy to answer questions about Atlas!
How does it compare to Google's Genie 3 or other similar models? At first glance it does look much more impressive visually
One of the biggest differences is the conditioning signal. Genie 3 and similar input raw keyboard commands (WASD + arrow keys), while Atlas inputs camera poses. This small difference means that Genie 3 has no 3D whatsoever; the model needs to learn an internal mapping between keyboard commands, world states, and pixels; and with Genie 3 there is no clear way to control the generated world aside from the input image and text prompt. Since Atlas makes camera pose explicit it can use posed input frames to shape the generated world, giving you a lot more creative control.
Another big differentiator is multimodality. Genie 3 only outputs pixels. Atlas also outputs pixels, but it can also output explicit 3D for the cases where you need it (such as plugging into game engines, simulators, or VFX workflows)