Isn't this a Gaussian Splat model? I work in AI and, to this day, I don't know what they mean by “world” in “world model”.
but it sounds cool
Marble: A Multimodal World Model
21–30 of 87 posts
Re: Marble: A Multimodal World Model
#22What happens when you prompt one of these kind of models with de_dust? Will it autocomplete the rest of the map? edit: Just tried it and it doesn't, but it does a good job of creating something like a CS map.
>What happens when you prompt one of these kind of models with de_dust?
Presumably de_dust2
Re: Marble: A Multimodal World Model
#23Isn't this a Gaussian Splat model? I work in AI and, to this day, I don't know what they mean by “world” in “world model”.
Yeh I still don't think there's a fixed definition of what a world model is or in what modality it will emerge. I'm unconvinced it will emerge as a satisfying 3d game-like first-person walkthrough.
Re: Marble: A Multimodal World Model
#24I understand that DeepMind is working on this too: https://deepmind.google/blog/genie-3-a-new-frontier-for-worl... I wonder how their approaches and results compare?
From what I can tell, you can actually export a mesh in (paid) Marble, whereas I haven't seen mesh exports offered in Genie 3 yet (could be wrong though).
Re: Marble: A Multimodal World Model
#25RIP GTA6
Re: Marble: A Multimodal World Model
#26Isn't this a Gaussian Splat model? I work in AI and, to this day, I don't know what they mean by “world” in “world model”.
Yeh I still don't think there's a fixed definition of what a world model is or in what modality it will emerge. I'm unconvinced it will emerge as a satisfying 3d game-like first-person walkthrough.
I think absolutely it will in a year
Re: Marble: A Multimodal World Model
#27I like that they distinguish between the collider mesh (lower poly) and the detailed mesh (higher poly).
As a game developer I'm looking for:
• Export low-poly triangle mesh (ideally OBJ or FBX format — something fairly generic, nothing too fancy) • Export texture map • Export normals • Bonus: export the scene as "de-structured" objects (e.g. instead of a giant world mesh with everything baked into it, separate exports for foreground and background objects to make it more game engine-ready.
Gaussian splats are awesome, but not critical for my current renderers. Cool to have though.
Re: Marble: A Multimodal World Model
#28Is Marble's definition of a "world model" the same as Yann LeCun's definition of a world model? And is that the same as Genie's definition of a world model?
Re: Marble: A Multimodal World Model
#29If biology operated this way animals would never have evolved. This is bunk, it has nothing to do with intelligence and everything to do with hyping the oxymoronic/paradox branded as spatial intelligence. It's a flimsy way of using binary to burn energy.
Senses do not represent, if we needed them to in order to survive, we'd be dead before we never saw that branch, or that step, etc. This is the same mistaken approach cog-sci took in inventing the mind from the brain.
The problem is the whole brain prior to sensory and emotional integration is deeply involved so that an incredibly shallow oscillatory requirement fits atop the depth of long-term path-integration, memory consolidation involving allo and egocentric references of space and time, these are then correlated in affinities by sense emotion relays or values. None of this is here, it's all discarded for junk volumes made arbitrary, whereas the spaces here are immeasurably specific, fused by Sharp Wave Ripples.
There's no world model in the instantaneous shallow optic flow response (knowing when to slam on brakes, or pull in for a dive) and in the deep entanglements of memory and imagination and creativity.
This is one-size fits all nonsense. It's junk. It can't hope to resolve the space time requirements of shallow and deep experiences.
Re: Marble: A Multimodal World Model
#30Incredibly disappointing release, especially for a company with so much talent and capital.
Looking at the worlds generated here https://marble.worldlabs.ai/ it looks a lot more like they are just doing image generation for a multiview stereo 360 panoramas and then reprojecting that into space. The generations exhibit all the same image artifacts that come from this type of scanning/reconstruction work, all the same data shadow artifacts, etc.
This is more of a glorified image generator, a far cry from a "world model".