Cool demo! That's funny. I literally sketched out something similar 30 minutes ago on paper. I wonder if there was some recent, semi-related article/link that subconsciously prompted the relevance.
This, maybe?
Fable 5.1 World Modeling
31–40 of 112 posts
Re: Fable 5.1 World Modeling
#32fable 5.1 generated an interactive 3D union square, and the agent filmed its own tour guide vid inside it. you can walk Powell to Stockton, read the actual storefronts, cross a working intersection, watch a cable car go by. went inside Apple and the Nintendo store, lower level included check source code + more worlds soon
Do you have data on the tokens or $ cost of this?
this is a one-shot result but i have a really really lengthy prompt: https://github.com/PhiloLabs/fable51-worlds/blob/main/union-... with clear guidance in using subagents and self-QA loop.
~2 hour (extensive subagents usage), total ~8M tokens, ~$33 under API
Re: Fable 5.1 World Modeling
#33I have experimented with this type of modeling for a RTS game I'm building: https://playwarpact.com Few things: 1. Opus 5 is just as good for this tbh and cheaper. 2. They don't generate optimized 3d models. They have high poly count for simple geometries. 3. A better approach I've utilized for game ready assets is to use the model to create low poly silhouettes of the 3d model and then bake textures that include a l…
I’m interested! I struggled to get goos detail on my Back to the Future Delorean 3D animation on my docs hero: https://contextify.sh/docs/
I posted this previously and people wanted more info so here is how I built it, with a deeper dive into some film scene recreation I worked on focusing on a scene from Apocalypto:
https://banagale.com/cinematic-canvas-ai-film-animation.htm
I’d love to improve the look of these things.
Re: Fable 5.1 World Modeling
#34This is beautiful! I would love if we could model out a whole city, ideally using a much cheaper model.
I'm really curious how GML-5.3-flash would do. Very affordable, and it seems to do pretty well with 3D modeling.
yes experimenting with it actually, will update here! in fact we've generated most of the tourist spots in sf, should be reflected in the repo soon too
Re: Fable 5.1 World Modeling
#35Cool. But the question remains, what is the point of this? I don't mean to pick on this project specifically, but it's indicative of AI usage in general. You end up with something that's like "wow an AI made this" but it's not really anything that interesting or useful in and of itself. I've yet to see a single agent generated piece of software above that bar.
the topology/texturing critique is fair for mesh generation, but code-generated worlds mostly sidestep it. when the model writes three.js or blender scripts, geometry comes from primitives, csg, and parametric construction, so topology is clean by construction rather than something you clean up after. texturing is still a gap, agreed, though procedural materials cover more than people expect.
Re: Fable 5.1 World Modeling
#36Cool. But the question remains, what is the point of this? I don't mean to pick on this project specifically, but it's indicative of AI usage in general. You end up with something that's like "wow an AI made this" but it's not really anything that interesting or useful in and of itself. I've yet to see a single agent generated piece of software above that bar.
the topology/texturing critique is fair for mesh generation, but code-generated worlds mostly sidestep it. when the model writes three.js or blender scripts, geometry comes from primitives, csg, and parametric construction, so topology is clean by construction rather than something you clean up after. texturing is still a gap, agreed, though procedural materials cover more than people expect.
[dead]
Re: Fable 5.1 World Modeling
#37I have experimented with this type of modeling for a RTS game I'm building: https://playwarpact.com Few things: 1. Opus 5 is just as good for this tbh and cheaper. 2. They don't generate optimized 3d models. They have high poly count for simple geometries. 3. A better approach I've utilized for game ready assets is to use the model to create low poly silhouettes of the 3d model and then bake textures that include a l…
> Opus 5 is just as good for this tbh and cheaper.
It depends on the fidelity, there's a threshold slightly over "low poly" that Opus cannot get over. Once you get into creating foliage l-systems, or physical mob animation, or a house with realistic appliances, Opus is under the convergence threshold for a world model no matter how much time you give it, it will flail around and say it's done even though it's nowhere close to plausible. Fable takes forever but knows how to zoom in and out on the abstractions.
> They don't generate optimized 3d models. They have high poly count for simple geometries.
By default LLMs will do the quick prototype thing and slap some primitives into a THREE.js scene. Which is probably correct because most users don't know or care. But if prompted Fable will connect the manifolds/sculpt with a mesher, instance out the pieces, etc. and make you an efficient art pipeline. You can make it optimized. Just not in 10 minutes.
> A better approach I've utilized for game ready assets is to use the model to create low poly silhouettes
You can also let Meshy make the geo and then fit it back to the world with PCA + BB's. Diffusion models are still 10x better at making physically plausible geometries than LLMs, plus they are faster all things considered. One technique I've found that works well is socketing; let the LLM generate the high level structure with blockouts for sockets, then slot in the higher poly objects that fit. Which is closer to the professional approach for world design.
Re: Fable 5.1 World Modeling
#38I wish you would provide more information. About time, costs, reliability (how many duds did you have? did you need to do any babysitting or etc) and so on But it is a very impressive looking demo, for sure.
this is a one-shot result but i have a really really lengthy prompt: https://github.com/PhiloLabs/fable51-worlds/blob/main/union-... with clear guidance in using subagents and self-QA loop.
~2 hour (extensive subagents usage), total ~8M tokens, ~$33 under API
Re: Fable 5.1 World Modeling
#39This isn't what I expected when I heard "world model"!
ik, "world model" has too many definitions at this point. imo the bar is just: can it simulate the world.
Re: Fable 5.1 World Modeling
#40This looks great.