Le Cunn's talk at Harvard informs how far behind he is.
Why Fei-Fei Li and Yann LeCun are both betting on "world models"
31–40 of 105 posts
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#32With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.
AI might be the biggest transfer of wealth from the rich to the poor in history. Billions have been poured into closed sourced models which have led directly and indirectly to open weight models being available to everyone.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#33[dead]
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#34Everytime I see LeCun talk about world models, I can’t help but think it is also just a tweak on the fundamentals of what is behind current LLM technology. In the end it’s still neural networks. To me, having to “teach” the model how physics works makes me think it can’t be true AGI either.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#35I played with Marble yesterday, Fei-Fei/World Labs' new product. It is the most impressed I've been with an AI experience since the first time I saw a model one-shot material code. Sure, its an early product. The visual output reminds me a lot of early SDXL. But just look at what's happened to video in the last year and image in the last three. The same thing is going to happen here, and fast, and I see the vision fo…
I wasn't actually able to use it because the servers were overloaded. What exactly impressed you (or more generally, what does it actually let you do at the moment?).
You give it a text prompt and optional image.
What you get is a 3D room based on the prompt/image. It rewrites your prompt to a specific format. Overall the rooms tend to be detailed and imaginative.
Then you can fly around the room like in Minecraft creative mode. Really looking forward to more editing features/infill to augment this.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#36Danijar Hafner just left DeepMind. He's behind the Dreamer series of models which are IMO the most promising direction for world models anyone has come up with yet. I'm wondering where he's headed. Maybe he could end up at LeCun's startup?
In Dreamer 4 they are able to train an agent to play Minecraft with enough skill to obtain diamonds, without ever playing the game at all. Only by watching humans play. They first build a world model, then train the agent purely in scenarios imagined by the world model, requiring zero extra data or experience. Hopefully it's obvious how generating data from a world model might be useful for training agents in domains where we don't have datasets like the entire internet just sitting around ready-made for us to use.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#37With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.
The most useful models are image, video, and audio models. It makes sense that we'd make the video models more 4D aware. Text really hogged all the attention. Media is where AI is really going to shine. Some of the most profitable models right now are in music, image, and video generation. A lot of people are having a blast doing things they could legitimately never do before, and real working professionals are able…
>Some of the most profitable models right now are in music, image, and video generation.
I don’t think many of the companies running these make a profit right now
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#38With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.
AI might be the biggest transfer of wealth from the rich to the poor in history. Billions have been poured into closed sourced models which have led directly and indirectly to open weight models being available to everyone.
Open weight models aren’t worth very much money to most people.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#39Earlier quoted context omitted.
All abstraction of reality are bound to fail, but some abstractions are more convincing (or indeed more useful) than others. > Any real AI that veers at control will have to adopt a neurobio path Maybe. Or maybe it's a useless distraction. Only time will tell what signals are meaningful.
[dead]
I think you place more meaning in "intelligence" than I do, and certainly more meaning in current models of the brain. We'll see.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#40The LLM grift is burned up, so this is the next thing. It has just enough new magic tricks to wow the VCs who don't really get what's going on here. I think this comment from the article says it all: “Taking images and turning them into 3D environments using gaussian splats, depth and inpainting. Cool, but that’s a 3D GS pipeline, not a robot brain.”
One problem with VR and VFX is how expensive it is in terms of man hours to create immersive worlds. This significantly reduces the cost and has applications in all sorts of ways and could realistically improve the availability of content in VR and reduce movie production costs. And that’s just the obvious applications (ignoring that these world models can be used to train AI itself)