Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yann LeCun to depart Meta and launch AI startup focused on 'world models'

nasdaq.com

Post reply on HN
Print view View original

21–30 of 680 posts

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#21

Post by hhh »

raverbashing wrote: post #12
tinco wrote: post #10

Earlier quoted context omitted.

Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.

Yeah honestly I'm with the LLM people here If you think LLMs are not the future then you need to come with something better If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation As Linus says, "talk is cheap, show me the code".

LLMs are the present. We will see what the future holds.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#22

Post by thiago_fm »

Everybody has found out how LLMs no longer have a real research expanding horizon. Now most progress will likely be done by tweaks in the data, and lots of hardware. OpenAI's strategy.

And also it has extreme limitations that only world models or RL can fix.

Meta can't fight Google (has integrated supply chain, from TPUs to their own research lab) or OpenAI (brand awareness, best models).

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#24

Post by consumer451 »

killerstorm wrote: post #14
lm28469 wrote: post #11

But wait they're just about to get AGI why would he leave???

LeCun always said that LLMs do not lead to AGI.

Can anyone explain to me the non-$$ logic for one working towards AGI, aside from misanthropy?

The only other thing I can imagine is not very charitable: intellectual greed.

It can't just be that, can it? I genuinely don't understand. I would love to be educated.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#26

Post by Seattle3503 »

raverbashing wrote: post #12
tinco wrote: post #10

Earlier quoted context omitted.

Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.

Yeah honestly I'm with the LLM people here If you think LLMs are not the future then you need to come with something better If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation As Linus says, "talk is cheap, show me the code".

Well, we will see if Yann can.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#27

Post by lmm »

yanhangyhy wrote: post #19

What the hell does Mark see in Wang? Wang was born into a family whose parents got Chinese government scholarships to study abroad but secretly stayed in the US, and then the guy turns super anti-China. From any angle, this dude just doesn't seem reliable at all.

> Wang was born into a family whose parents got Chinese government scholarships to study abroad but secretly stayed in the US, and then the guy turns super anti-China.

All I'm hearing is he's a smart guy from a smart family?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#28

Post by worldsayshi »

raverbashing wrote: post #12
tinco wrote: post #10

Earlier quoted context omitted.

Yeah I think LeCun is underestimating the impact that LLM's and Diffusion models are going to have, even considering the huge impact they're already having. That's no problem as I'm sure whatever LeCun is working on is going to be amazing as well, but an enterprise like Facebook can't have their top researcher work on risky things when there's surefire paths to success still available.

Yeah honestly I'm with the LLM people here If you think LLMs are not the future then you need to come with something better If you have a theoretical idea that's great, but take to at least GPT2 level first before writing off LLMs Theoretical people love coming up with "better ideas" that fall flat or have hidden gotchas when they get to practical implementation As Linus says, "talk is cheap, show me the code".

Why not both? LLM:s probably have a lot more potential than what is currently being realized but so does world models.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#30

Post by sebmellen »

numpy-thagoras wrote: post #15

Good. The world model is absolutely the right play in my opinion. AI Agents like LLMs make great use of pre-computed information. Providing a comprehensive but efficient world model (one where more detail is available wherever one is paying more attention given a specific task) will definitely eke out new autonomous agents. Swarms of these, acting in concert or with some hive mind, could be how we get to AGI. I wish…

Can you explain this “world model” concept to me? How do you actually interface with a model like this?
Post reply on HN