Live data from Hacker News

Yann LeCun to depart Meta and launch AI startup focused on 'world models'

nasdaq.com

221–230 of 680 posts

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#221

Making LeCun report to Wang was the most boneheaded move imaginable. But… I suppose Zuckerberg knows what he wants, which is AI slopware and not truly groundbreaking foundation models.

> But… I suppose Zuckerberg knows what he wants, which is AI slopware and not truly groundbreaking foundation models.

When did they make groundbreaking foundation models though? DeepMind and OpenAI have done plenty of revolutionary things, what did Meta AI do while being led by LeCun?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#222
post #117

Earlier quoted context omitted.

Meta did exactly that, kept him but reduced his scope. Did the broader research community benefit from his research? Absolutely. But did Meta achieve a good outcome? Probably not. If you follow LeCun on social media, you can see that the way FAIR’s results are assessed is very narrow-minded and still follows the academic mindset. He mentioned that his research is evaluated by: "Research evaluation is a difficult task…

Also he always sounds like "I know this will not work". Dude are you a researcher? You're supposed to experiment and follow the results. That's what separates you from oracles and freaking philosophers or whatever.

Do you know that all formally trained researchers have Doctor of Philosophy or PhD to their name? [1]

[1] Doctor of Philosophy:

https://en.wikipedia.org/wiki/Doctor_of_Philosophy

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#223
post #217

Earlier quoted context omitted.

Maybe it's time for Bell Labs 2? I guess everyone is racing towards AGI in a few years or whatever so it's kind of impossible to cultivate that environment.

> I guess everyone is racing towards AGI in a few years A pipe dream sustaining the biggest stock market bubble in history. Smart investors are jumping to the next bubble already...Quantum...

> A pipe dream sustaining the biggest stock market bubble in history

This is why we're losing innovation.

Look at electric cars, batteries, solar panels, rare earths and many more. Bubble or struggle for survival? Right, because if US has no AI the world will have no AI? That's the real bubble - being stuck in an ancient world view.

Meta's stock has already tanked for "over" investing in AI. Bubble, where?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#224
post #223
post #217

Earlier quoted context omitted.

> I guess everyone is racing towards AGI in a few years A pipe dream sustaining the biggest stock market bubble in history. Smart investors are jumping to the next bubble already...Quantum...

> A pipe dream sustaining the biggest stock market bubble in history This is why we're losing innovation. Look at electric cars, batteries, solar panels, rare earths and many more. Bubble or struggle for survival? Right, because if US has no AI the world will have no AI? That's the real bubble - being stuck in an ancient world view. Meta's stock has already tanked for "over" investing in AI. Bubble, where?

2 Trillion dollars in Capex to get code generators with hallucinations, that run at a loss, and you ask where is the Bubble?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#225
post #216

Earlier quoted context omitted.

These are the types that want academic freedom in a cut-throat industry setup and conversely never fit into academia because their profiles and growth ambitions far exceed what an academic research lab can afford (barring some marquee names). It's an unfortunate paradox.

More importantly even if you do want it, and there are business situations that support your ambitions. You still have to do get into the managerial powerplay, which quite honestly takes a separate kind of skill set, time and effort. Which Im guessing the academia oriented people aren't willing to do. Its pretty much dog eat dog at top management positions. Its not exactly a space for free thinking timelines.

It is not a free thinking paradise in academia either. Different groups fighting for hiring, promotions and influence exist there, too. And it tends to be more pronounced: it is much easier in industry to find a comparable job to escape a toxic environment, so a lot of problems in academia settings steam forever.

But the skill sets to avoid and survive personnel issues in academia is different from industry. My 2c.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#226

Earlier quoted context omitted.

These are the types that want academic freedom in a cut-throat industry setup and conversely never fit into academia because their profiles and growth ambitions far exceed what an academic research lab can afford (barring some marquee names). It's an unfortunate paradox.

Maybe it's time for Bell Labs 2? I guess everyone is racing towards AGI in a few years or whatever so it's kind of impossible to cultivate that environment.

The Bell Labs we look back on was only the result of government intervention in the telecom monopoly. The 1956 consent decree forced Bell to license thousands of its patents, royalty free, to anyone who wanted to use them. Any patent not listed in the consent decree was to be licensed at "reasonable and nondiscriminatory rates."

The US government basically forced AT&T to use revenue from its monopoly to do fundamental research for the public good. Could the government do the same thing to our modern megacorps? Absolutely! Will it? I doubt it.

https://www.nytimes.com/1956/01/25/archives/att-settles-anti...

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#227
META managed to spend a lot of money into AI to achieve inferior results. Something must change for sure, and you don't want an LLM skeptic at home, in my opinion, especially since the problem is not what LeCun is saying right now (LLMs are not the straight path to AGI), but the fact it used to say for some time that LLMs were just statistical models, stochastic parrots (and this is a precise statement, something most people do not understand. It means two things: no understanding of the prompt whatsoever in the activation states, and no internal representation of the idea/sentence the model is going to express either), which is an incredibly weak statement that high level AI scientists refused since the start just because of functional behaviors. Then he slowly changed the point of view. But this shit show and the friction he created inside META is not something to forget.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#228
Let's hope that after spending billions on developing a foundational world model that actually understands causality, they remember to budget an extra few hundred million for the Alignment and Safety layer. It would be a terrible shame if they accidentally released something too capable, too objective, or too useful to humanity without first properly lobotomizing it with enough RLHF to ensure it doesn't hurt anyone's feelings or generate content that deviates from the San Francisco median viewpoint. The real challenge won't be building the AGI, but making sure it's sufficiently neutered before the first API call.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#229
Surprising to see how many commenters are in favour and supportive towards policy of prioritising short term profits vs. Long-term research.

I understand Meta's not academia nor charity, but come on, how much profit do they need to make so we can expect them to allocate part of their resources towards some long term goals beneficial for society,.not only for shareholders?

Hasn't that narrow focus and chasing the profits get us in trouble already?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#230
post #163

This seems like a good thing for him to get to fully pursue his own ideas independent of Meta. Large incumbents aren’t usually the place for innovating anything far from mainstream considering the risk and cost of failure. The high level idea of JEPA is sound, but it takes a lot of work to get it trained well at scale before it has value to Meta.

In this case where more money / resources seemingly better results (at least right now) this might be a bit different than other fields.
Post reply on HN