Live data from Hacker News

Yann LeCun to depart Meta and launch AI startup focused on 'world models'

nasdaq.com

181–190 of 680 posts

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#181

Earlier quoted context omitted.

I am in the "Yann is no longer the right person for the job" camp and I yet "LeCun failed to deliver anything that delivered real value to stockholders" is a wild thing to say. How do you read the list you compiled and say otherwise?

LLAMA sucks, that's the problem. Do you see value in it? Pytorch, used by everyone, yet no real value to stockholders, META even "fired" the creator of pytorch days ago. SAM is great, what value does it bring to META business? Nobody knows about it. Great tool BTW. JEPA is a failure (will it get better? I hope so.) Did you read my list?

Okay. Now explain the value that a halo car brings to car companies.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#182
post #169

Earlier quoted context omitted.

Isn't this idea demonstrably false due to the existence of various sensory disorders too? I have a disorder characterised by the brain failing to filter own its own sensory noise, my vision is full of analogue TV-like distortion and other artefacts. Sometimes when it's bad I can see my brain constructing an image in real time rather than this perception happening instantaneously, particularly when I'm out walking. A…

Pleased to meet someone else who suffers from "visual snow". I'm fortunate in that like my tinnitus, I'm only acutely aware of it when I'm reminded of it, or, less frequently, when it's more pronounced. You're quite correct that our "reality" is in part constructed. The Flashed Face Distortion Effect [0][1] (wherein faces in the peripheral vision appear distorted due the the brain filling in the missing information w…

Ah that's interesting, mine is omnipresent and occasionally bad enough I have to take days off work as I can't read my own code; it's like there's a baseline of it that occasionally flares up at random. Were you born with visual snow or did you acquire it later in life? I developed it as a teenager, and it was worsened significantly after a fever when I was a fresher.

Also do you get comorbid headaches with yours out of interest?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#183
post #117

Earlier quoted context omitted.

Meta did exactly that, kept him but reduced his scope. Did the broader research community benefit from his research? Absolutely. But did Meta achieve a good outcome? Probably not. If you follow LeCun on social media, you can see that the way FAIR’s results are assessed is very narrow-minded and still follows the academic mindset. He mentioned that his research is evaluated by: "Research evaluation is a difficult task…

Also he always sounds like "I know this will not work". Dude are you a researcher? You're supposed to experiment and follow the results. That's what separates you from oracles and freaking philosophers or whatever.

He's speaking to the entire feedforward Transformer-based paradigm. He sees little point in continuing to try to squeeze more blood out of that stone and instead move on to more appropriate ways to model ontologies per se rather than the crude-for-what-we-use-them-for embedding-based methods that are popular today.

I really resonate with his view due to my background in physics and information theory. I for one welcome his new experimentation in other realms while so many still hack away at their LLMs in pursuit of SOTA benchmarks.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#184
post #173

Earlier quoted context omitted.

What does Meta even want with AI? I suppose they could solve superintelligence and cure cancer and build fusion reactors with it, but that's 100% outside their comfort zone - if they manage to build synthethic conversation partners and synthethic content generators as good or better than the real thing the value of having every other human on the planet registered to one of their social network goes to zero. Which is…

they are out for your clicks and attention minutes if OpenAI can build a "social" network of completely generated content, that can kill Meta. Even today I venture to guess that most of the engagements in their platforms is not driven by real friends, so an AI driven platform won't be too different, or it might make content generation be so easy as to make your friends engage again. Apart from it the ludicrous vision…

How do LLMs help with clicks and attention minutes? Why do they spend $100+B a year in AI capex, more than Google and Microsoft that actually rent AI compute to clients? What are they going to do with all that compute? It’s all so confusing

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#185
post #33

Interesting he isn't just working with Feifei Li if he's really interested in 'world models'.

Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#186
post #48
post #38

Earlier quoted context omitted.

I politely disagree - it is exactly an industry researcher's purpose to do the risky things that may not work, simply because the rest of the corporation cannot take such risks but must walk on more well-trodden paths. Corporate R&D teams are there to absorb risk, innovate, disrupt, create new fields, not for doing small incremental improvements. "If we know it works, it's not research." (Albert Einstein) I also agre…

> it is exactly a researcher's purpose to do the risky things that may not work Maybe at university, but not at a trillion dollar company. That job as chief scientist is leading risky things that will work to please the shareholders.

> risky things that will work

Things known to work are not risky. Risky things can fail by definition.

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#187
post #89

I think it was a plan by Mark to move LeCun out of Meta. And they cannot fire him without bad PR, so they got Wang to lead him. It was only a matter of time before LeCun moved out.

Isn't putting Wang as leading him a worse PR compared to just letting him go?

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#189
post #173

Earlier quoted context omitted.

they are out for your clicks and attention minutes if OpenAI can build a "social" network of completely generated content, that can kill Meta. Even today I venture to guess that most of the engagements in their platforms is not driven by real friends, so an AI driven platform won't be too different, or it might make content generation be so easy as to make your friends engage again. Apart from it the ludicrous vision…

How do LLMs help with clicks and attention minutes? Why do they spend $100+B a year in AI capex, more than Google and Microsoft that actually rent AI compute to clients? What are they going to do with all that compute? It’s all so confusing

It might be just me, but in my opinion facebook platforms are way past the "content from your friends phase", but is full of cheap peddled viral content.

If that content becomes even cheaper, of higher quality and highly tailored to you, that is probably worth a lot of money, or at least worth not losing your entire company by a new competitor

Re: Yann LeCun to depart Meta and launch AI startup focused on 'world models'

#190

Earlier quoted context omitted.

LLMs get results is quite the bold statement. If they get results, they should be getting adopted, and they should be making money. This is all built on hazy promises. If you had marketable results, you wouldn't have to hide 20+ billion dollars of debt financing into an obscure SPV. LLMs are the most baffling piece of tech. They are incredible, and yet marred by their non-deterministic hallucinatory nature, and bound…

OpenAI and Anthropic are making north of 4B/year revenue so some companies have figured out the money making part. ChatGPT has some 800M users according to some calculations. Whether it's enough money today, enough money tomorrow, is of course a question but there is a lot of money. Users would not use them in a scale if they do not solve their problems.

OpenAI lost 12bn last quarter
Post reply on HN