Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
1–10 of 147 posts
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#2[deleted]
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#3"[Yann LeCun] believes [current] LLMs will be largely obsolete within five years."
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#4Recent talk:
https://www.youtube.com/watch?v=ETZfkkv6V7Y
LeCun, "Mathematical Obstacles on the Way to Human-Level AI"
Slide (Why autoregressive models suck)
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#5"[Yann LeCun] believes [current] LLMs will be largely obsolete within five years."
Obsolete by?
This seems like a broken clock having a good chance of being right.
There's so much progress, it wouldn't be that surprising if something quite different completely overtakes the current trend within 5 years.
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#6Recent talk: https://www.youtube.com/watch?v=ETZfkkv6V7Y LeCun, "Mathematical Obstacles on the Way to Human-Level AI" Slide ( Why autoregressive models suck ) https://xcancel.com/ravi_mohan/status/1906612309880930641
The error with that is that human reasoning is not mathematical. Math is just one of the many tools of reason.
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#7[flagged]
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#8> Returning to the topic of the limitations of LLMs, LeCun explains, "An LLM produces one token after another. It goes through a fixed amount of computation to produce a token, and that's clearly System 1—it's reactive, right? There's no reasoning," a reference to Daniel Kahneman's influential framework that distinguishes between the human brain's fast, intuitive method of thinking (System 1) and the method of slower, more deliberative reasoning (System 2).
Many people believe that "wants" come first, and are then followed by rationalizations. It's also a theory that's supported by medical imaging.
Maybe the LLM are a good emulation of system-2 (their perfomance sugggest it is), and what's missing is system-1, the "reptilian" brain, based on emotions like love, fear, aggression, (etc.).
For all we know, the system-1 could use the same embeddings, and just work in parallel and produce tokens that are used to guide the system-2.
Personally, I trust my "emotions" and "gut feelings": I believe they are things "not yet rationalized" by my system-2, coming straight from my system-1.
I know it's very unpopular among nerds, but it has worked well enough for me!
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#9Recent talk: https://www.youtube.com/watch?v=ETZfkkv6V7Y LeCun, "Mathematical Obstacles on the Way to Human-Level AI" Slide ( Why autoregressive models suck ) https://xcancel.com/ravi_mohan/status/1906612309880930641
The error with that is that human reasoning is not mathematical. Math is just one of the many tools of reason.
Did you read the slide? It doesn't make the argument you are responding to, you just seem to have been prompted by "Math".
Re: Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete
#10> Returning to the topic of the limitations of LLMs, LeCun explains, "An LLM produces one token after another. It goes through a fixed amount of computation to produce a token, and that's clearly System 1—it's reactive, right? There's no reasoning," a reference to Daniel Kahneman's influential framework that distinguishes between the human brain's fast, intuitive method of thinking (System 1) and the method of slower…
Re the "medical imaging" reference, many of those are built on top of one famous study recording movement before conscious realization that isn't as clear-cut as it entered popular knowledge as: https://www.theatlantic.com/health/archive/2019/09/free-will...
I know there are other examples, and I'm not attacking your post; mainly it's a great opportunity to link this IMHO interesting article that interacts with many debates on HN.