This article has aged very poorly. It's hard to look at LLMs and argue they don't have reasoning capability.
They don't have any reasoning capability. There is nowhere in their architecture that would give them the ability to reason. All they do is predict what would be the most likely word to go next in the sentence, considering the current text and the input text.
Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
21–30 of 83 posts
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#22Stop calling everything a robot while you are at it. Once marketing folk get their paws on terms they can lose or expand their meaning. It's just the way it is.
Others say it has to look human to be considered a robot.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#23AI Is the PERFECT name for all of this stuff. Artificial Intelligence. He's arguing because it's artificial it shouldn't be called artificial.
He's arguing that AI should be closer to what the public calls AGI. The semantics are important here, since people think that LLMs like chatGPT have intellect, and some have even gone so far as to tie an IQ to it. The truth is that the model has no intelligence, but can do what we attribute to humans intelligence. Alike to how computers were deemed intelligent by the public for doing fast mathematics, computers still…
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#24We'd do better to stop conflating AI with machine learning. Machine learning can be one way to create AI, but it doesn't end there.
I think you missed the point of the article. What he says is AI is more alike to what the public calls AGI.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#25Earlier quoted context omitted.
They don't have any reasoning capability. There is nowhere in their architecture that would give them the ability to reason. All they do is predict what would be the most likely word to go next in the sentence, considering the current text and the input text.
What is reasoning other than predicting what next step is most likely to produce a desired outcome? That's all it feels like the mind is doing. Is there a more formal take?
ChatGPT doesn't care what word it puts in front of you, and if it's true or not. Reasoning must have a goal, and current LLMs don't. All it does it repeat what are the most common words that they've seen.
It also doesn't think. It's a completely forward process. It's definitely a part of human thinking, but not the reasoning part.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#26AI Is the PERFECT name for all of this stuff. Artificial Intelligence. He's arguing because it's artificial it shouldn't be called artificial.
> He's arguing because it's artificial it shouldn't be called artificial. No, he's arguing that it shouldn't be called intelligent because it is not.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#27Earlier quoted context omitted.
He's arguing that AI should be closer to what the public calls AGI. The semantics are important here, since people think that LLMs like chatGPT have intellect, and some have even gone so far as to tie an IQ to it. The truth is that the model has no intelligence, but can do what we attribute to humans intelligence. Alike to how computers were deemed intelligent by the public for doing fast mathematics, computers still…
What if self-reflection, agency, or abstract thought aren’t required for intelligence?
Intelligence, reasoning and AI are all very loosely defined words, and unfortunately neuroscience hasn't gone far enough to explain a lot of these mechanisms.
We could maybe compare AI to a dog's intelligence, but even then there's a goal system in the dog, and the dog wants to optimize for it (getting treats). LLMs are created to be purely tools, and not reflective or goal-oriented.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#28Sure, right after we stop calling linear algebra and matrix manipulation "machine learning".
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#29In other words, it's already way too late. New, more specific words are already being formed, such as AGI.
Re: Stop Calling Everything AI, Machine-Learning Pioneer Says (2021)
#30Earlier quoted context omitted.
I think you missed the point of the article. What he says is AI is more alike to what the public calls AGI.
That may be, but then his position doesn't stand up as nobody calls everything AI in the AGI sense in the first place. AI is indeed used often, but it is very much understood that it means something quite different to AGI (hence the two different terms).
Language is fluid, and I don't think he'll win this battle. Even if the current ML models aren't intelligent, it's probably better to just go with the flow instead of being stuck on pedantry.