Earlier quoted context omitted.
These are the types that want academic freedom in a cut-throat industry setup and conversely never fit into academia because their profiles and growth ambitions far exceed what an academic research lab can afford (barring some marquee names). It's an unfortunate paradox.
Meta has the financial oomph to run multiple Bell Labs within its organization. Why they decided not to do that is kind of a puzzle.
Yann LeCun to depart Meta and launch AI startup focused on 'world models'
621–630 of 680 posts
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#622Earlier quoted context omitted.
Seems these users are getting it on VS code, while I am getting the exact same thing when using claude code on a Linux server over SSH from Windows Terminal. At this point their app has to be the only thing in common?
That's certainly an interesting observation. I wonder if they produce one client that has some kind of abstraction layer for the user interface & that abstraction layer has hidden or obscured this detail?
You mean a terminal interface?
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#623Earlier quoted context omitted.
Can you explain this “world model” concept to me? How do you actually interface with a model like this?
He is one of these people who think that humans have a direct experience of reality not mediated by as Alan Kay put it three pounds of oatmeal. So he thinks a language model can not be a world model. Despite our own contact with reality being mediated through a myriad of filters and fun house mirror distortions. Our vision transposes left and right and delivers images to our nerves upside down, for gawd’s sake. He im…
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#624Earlier quoted context omitted.
IMO the issue is that animals can't have a specific "world model" system, because if you create a model ahead of time you will mostly waste energy because most of the model is not used. And animals' main concern is energy conservation, so they must be doing something else.
There are many factors playing into "survival of the fittest", and energy conservation is only one. Animals build mental models to predict the world because this superpower of seeing into the future is critical to survival - predict where the water is in a drought, where the food is, and how to catch it, etc, etc. The animal learns as it encounters learning signals - prediction failure - which is the only way to do i…
https://aaai.org/papers/00268-aaai87-048-pengi-an-implementa...
It instead works by "doing the thing that worked last time".
As an example, you don't usually need to know what is in your garbage in order to take out the trash.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#625Most of the folks on this topic are focused on Meta and Yann’s departure. But, I’m seeing something different. This is the weirdest technology market that I’ve seen. Researchers are getting rewarded with VC money to try what remains a science experiment. That used to be a bad word and now that gets rewarded with billions of dollars in valuation.
> This is the weirdest technology market that I’ve seen. The phenomenon you're seeing is well described here: "The Perfect AI Startup" ( https://www.bloomberg.com/opinion/newsletters/2025-09-29/the... ) “It was the most absurd pitch meeting,” one investor who met with Murati said. “She was like, ‘So we’re doing an AI company with the best AI people, but we can’t answer any questions.’” Despite that vagueness, Murati…
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#626Earlier quoted context omitted.
A world model is a persistent representation of the world (however compressed) that is available to an AI for accessing and compute. For example, a weather world model would likely include things like wind speed, surface temperature, various atmospheric layers, total precipitable water, etc. Now suppose we provide a real time live feed to an AI like an LLM, allowing the LLM to have constant, up to date weather knowle…
If your "world model" only models a small portion of the world, I think the more appropriate label is a time-series model. Once you truncate correlated data, the model you're left with isn't very worldly at all.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#627Earlier quoted context omitted.
If a "science experiment" has the chance to displace most labor then whoever's successful at the experiment wins the economy, period. There's nothing weird or surprising about the logic of them obsessively chasing it. They all have to, it's a prisoner's dilemma.
Fusion power has the chance to displace most power generation, and whoever is successful at the experiment wins the energy economy, period. However given the long timelines, high cost of research, and the unanswered technical questions around materials that can withstand neutron flux, the total 2024 investment into fusion is only around $10B, versus AI's 250+B. Why are these so different?
It's not clear if after that lot they would be cost competitive with other energy sources.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#628Earlier quoted context omitted.
Maybe it's time for Bell Labs 2? I guess everyone is racing towards AGI in a few years or whatever so it's kind of impossible to cultivate that environment.
I'd argue SSI and Thinking Machines Lab seem to that environment you are thinking about. Industry labs that focuses on research without immediate product requirement.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#629Earlier quoted context omitted.
LeCun always said that LLMs do not lead to AGI.
Can anyone explain to me the non-$$ logic for one working towards AGI, aside from misanthropy? The only other thing I can imagine is not very charitable: intellectual greed. It can't just be that, can it? I genuinely don't understand. I would love to be educated.
Human minds may be able to merge giving immortality.
Building minds may let us understand our own better and cure diseases.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#630Earlier quoted context omitted.
It's funny that the Netherlands seems to still live in the dotcom boom to this day. Want to adopt a pet? verhuisdieren.nl. Want to buy wall art? wall-art.nl. Need cat5 cable? kabelshop.nl. 8/10 times there is a (legit) online store for whatever you need, to the point where one of the local e-commerce giants (Coolblue) buys this type of domain and aliases them to their main site.
This is still the case in the US, too. I don't know why people are talking like it stopped happening. amazon.com, amazon.com, amazon.com, amazon.com All these things are still e-tail here, too. We didn't go back to B&M.
Having a dense country where you reach any opposite end in where it's coming from (sometimes it's Germany) as delivery time is the same. That would not be the case for the US, you'd require a web of distributors.