11–20 of 64 posts
Any ideas if it keeps continuity - when you turn around, is the invented chair still there, or does everything shift like in a dream?
This seems like by far the best model yet for reconstructing 3D spaces from sparse images. It looks like you could reconstruct your whole house with pretty good fidelity from a dozen or so images taken on your phone. They show it working with videos that have motion, but it seems like time is always frozen while the camera is moving, and they always return to a ground truth camera view before advancing time again. Ma…
But this is certainly one area we plan to improve going forward.
I'm a cofounder at World Labs - happy to answer questions about Atlas!
What exactly does world model mean? Ive seen it used so many times in so many ways to just describe SOTA anything its lost its meaning.
- Renderers output pixels or views of a world, either the real world or a generated world
- Simulators predict how the world responds to actions
- Planners predict actions for an agent to make to affect some change in the world
Under this taxonomy, Atlas is somewhere between renderer and simulator. It predicts high-quality views of a consistent 3D world (renderer) but it can also predict explicit 3D to aid in simulation. Atlas doesn't currently predict actions to directly drive a robot, so it isn't natively a planner; but its simulation abilities can help train another model to be planner.
Source: https://www.worldlabs.ai/blog/taxonomy-of-world-models
What exactly does world model mean? Ive seen it used so many times in so many ways to just describe SOTA anything its lost its meaning.
It's an overloaded term for AI models that have spatial reasoning LLMs currently lack. Best definition I've heard is: AI systems that can build an internal map of their surroundings to anticipate what happens next and make decisions based on their predictions about the consequences the different actions they can take would have. There's a bunch of different approaches people are trying: - World labs (linked in this p…
I'm a cofounder at World Labs - happy to answer questions about Atlas!
spacial context feature is cool - what are the limitations, if any? What would it take to geo and rotation tag every photo ever taken , combine it into a mass spatial context, run it through atlas and build an entire 3D model of the world?
Atlas is an auto-regressive diffusion model, so context length limitations apply similar to LLMs and video models.
Where Atlas has an edge is that its context comprised of an arbitrary sequence of images with camera poses, which lends itself to managing the context in creative ways (we called this "context juggling" in our RTFM blog, https://www.worldlabs.ai/blog/rtfm). So yes through clever context management you could potentially build an entire 3D model of the world.
I'm a cofounder at World Labs - happy to answer questions about Atlas!
spacial context feature is cool - what are the limitations, if any? What would it take to geo and rotation tag every photo ever taken , combine it into a mass spatial context, run it through atlas and build an entire 3D model of the world?
Earlier quoted context omitted.
spacial context feature is cool - what are the limitations, if any? What would it take to geo and rotation tag every photo ever taken , combine it into a mass spatial context, run it through atlas and build an entire 3D model of the world?
Atlas project lead here. Atlas is an auto-regressive diffusion model, so context length limitations apply similar to LLMs and video models. Where Atlas has an edge is that its context comprised of an arbitrary sequence of images with camera poses, which lends itself to managing the context in creative ways (we called this "context juggling" in our RTFM blog, https://www.worldlabs.ai/blog/rtfm ). So yes through clever…