But wait they're just about to get AGI why would he leave???
Yann LeCun to depart Meta and launch AI startup focused on 'world models'
11–20 of 680 posts
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#12Earlier quoted context omitted.
He is also not very interested in LLMs, and that seems to be Zuck's top priority.
Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.
Yeah honestly I'm with the LLM people here
If you think LLMs are not the future then you need to come with something better
If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs
Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation
As Linus says, "talk is cheap, show me the code".
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#13Earlier quoted context omitted.
He is also not very interested in LLMs, and that seems to be Zuck's top priority.
Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.
Unless I've missed a few updates, much of the JEPA stuff didn't really bear a lot of fruit in the end.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#14But wait they're just about to get AGI why would he leave???
LeCun always said that LLMs do not lead to AGI.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#15Good. The world model is absolutely the right play in my opinion.
AI Agents like LLMs make great use of pre-computed information. Providing a comprehensive but efficient world model (one where more detail is available wherever one is paying more attention given a specific task) will definitely eke out new autonomous agents.
Swarms of these, acting in concert or with some hive mind, could be how we get to AGI.
I wish I could help, world models are something I am very passionate about.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#16Earlier quoted context omitted.
Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.
Yeah honestly I'm with the LLM people here If you think LLMs are not the future then you need to come with something better If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation As Linus says, "talk is cheap, show me the code".
Of course the challenge with that is it's often not obvious until after quite a bit of work and refinement that something else is, in fact, better.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#17Earlier quoted context omitted.
He is also not very interested in LLMs, and that seems to be Zuck's top priority.
Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.
While I agree with your point, “Superintelligence” is a far cry from what Meta will end up delivering with Wang in charge. I suppose that, at the end of the day, it’s all marketing. What else should we expect from an ads company :?
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#18Earlier quoted context omitted.
Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.
Yeah honestly I'm with the LLM people here If you think LLMs are not the future then you need to come with something better If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation As Linus says, "talk is cheap, show me the code".
Do you? Or is it possible to acknowledge a plateau in innovation without necessarily having an immediate solution cooked-up and ready to go?
Are all critiques of the obvious decline in physical durability of American-made products invalid unless they figure out a solution to the problem? Or may critics of a subject exist without necessarily being accredited engineers themselves?
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#19What the hell does Mark see in Wang? Wang was born into a family whose parents got Chinese government scholarships to study abroad but secretly stayed in the US, and then the guy turns super anti-China. From any angle, this dude just doesn't seem reliable at all.
Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'
#20"These models aim to replicate human reasoning and understanding of the physical world, a project LeCun has said could take a decade to mature." What an insane time horizon to define success. I suppose he easily can raise enough capital for that kind of runway.
That guy has survived the AI winter. He can wait 10 years for yet another breakthrough. [but the market can’t] https://en.wikipedia.org/wiki/AI_winter
We're at most in an "AI Autumn" right now. The real Winter is yet to come.