Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
What would it mean exactly to be "more than statistics"? Does the human brain qualify?
How AI knows things no one told it
11–20 of 140 posts
Re: How AI knows things no one told it
#12Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
It's par for the course for the modern Scientific American which has fallen very very very far from its origins.
Re: How AI knows things no one told it
#13Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
Even if this kind of intelligence is just statistics, does it really matter? If it quacks like a duck, it's a duck. Maybe our own brains are nothing more than overrated statistical machines?
The only issue I see with the hype is when people attempt to anthromorphize it.
Re: How AI knows things no one told it
#14Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
Also very clearly a lot of people left holding the bag with crypto and are trying to resuscitate it with hype.
Re: How AI knows things no one told it
#15Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
Re: How AI knows things no one told it
#16Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
Re: How AI knows things no one told it
#17Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
What does it mean to be “more than statistics”? Is there anything that cannot be described as a statistic?
> “It is certainly much more than a stochastic parrot, and it certainly builds some representation of the world—although I do not think that it is quite like how humans build an internal world model,” says Yoshua Bengio, an AI researcher at the University of Montreal.
> At a conference at New York University in March, philosopher Raphaël Millière of Columbia University [...] went a step further and showed that GPT can execute code, too, however. The philosopher typed in a program to calculate the 83rd number in the Fibonacci sequence. “It’s multistep reasoning of a very high degree,” he says. And the bot nailed it. When Millière asked directly for the 83rd Fibonacci number, however, GPT got it wrong: this suggests the system wasn’t just parroting the Internet. Rather it was performing its own calculations to reach the correct answer.
> This impromptu ability demonstrates that LLMs develop an internal complexity that goes well beyond a shallow statistical analysis. Researchers are finding that these systems seem to achieve genuine understanding of what they have learned.
Re: How AI knows things no one told it
#18Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
If you invent/introduce made up concepts and rules on the spot ("let shmerple be ..."), which can't possibly be found in its training data, then, from my experience, when queried, LLMs are able to correctly reason most of the time... So it's not just Markov chains regurgitating sentences verbatim from their dataset. Even if this kind of intelligence is just statistics, does it really matter? If it quacks like a duck,…
Are we not simply employing statistics when we deduce that yes, if we release our grip, the smartphone will fall to the floor?
You wouldn't have to ever see a phone drop in order to know that, and neither would you have to study or know of the terminology of gravity.
It comes from the statistical knowledge that all things fall when not blocked.
Re: How AI knows things no one told it
#19Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.
Re: How AI knows things no one told it
#20Earlier quoted context omitted.
What would it mean exactly to be "more than statistics"? Does the human brain qualify?
Yeah, the brain is alive and is trying to keep the rest of the organism alive But n an environment.