Why Fei-Fei Li and Yann LeCun are both betting on "world models"
1–10 of 105 posts
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#2I don’t know enough about this to be sure, but this feels like a white whale.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#3If I was smarter, I would have predicted that not only would everyone else figure out that world models are a critical step, but that as a direct consequence the term "world model" would lose all meaning. Maybe next time. That said, Le Cunn's concept in the blog post is the only one worthy of the title.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#4I don’t know enough about this to be sure, but this feels like a white whale.
Human-level language was a white whale just a few years ago.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#5I don’t know enough about this to be sure, but this feels like a white whale.
I think video and agentic and multimodal models have led to this point, but actually making a world model may provide to be long and difficult.
I feel LeCun is correct that LLMs as of now have limitations where it needs an architectural overhaul. LLMs now have a problem with context rot, and this would hamper with an effective world model if the world disintegrates and becomes incoherent and hallucinated over time.
It'd doubtful whether investors would be in for the long haul, which may explain the behavior of Sam Altman in seeking government support. The other approaches described in this article may be more investor friendly as there is a more immediate return with creating a 3D asset or a virtual simulation.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#6Whether or not this is exactly the same thing, I find this glossary entry from NVIDIA interesting: https://www.nvidia.com/en-us/glossary/world-models/
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#7Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#8I always felt like one of reasons LLMs are so good is that they piggyback on the many years that have gone into developing language as an information representation/compression format. I don’t know if there’s anything similar a world model can take advantage of.
That being said there have been models which are pretty effective at other things that don’t use language, so maybe it’s a non issue.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#9I don’t know enough about this to be sure, but this feels like a white whale.
A trillion dollars are now riding on that white whale. An entire naval fleet is being raised for the purposes of chasing down that whale. LeCun and Fei-Fei merely believe that the whale is in a different ocean.
Re: Why Fei-Fei Li and Yann LeCun are both betting on "world models"
#10With all due respect, AI is ultimately a capital game. World models aren’t where real B2B customer revenue comes from—at least compared to today’s LLMs; they’re mainly a better story for raising huge amounts of private capital. Hopefully they figure out how to build the next-gen AI architecture along the way.