Live data from Hacker News

How AI knows things no one told it

scientificamerican.com

11–20 of 140 posts

Re: How AI knows things no one told it

#11
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

What would it mean exactly to be "more than statistics"? Does the human brain qualify?

Yeah, the brain is alive and is trying to keep the rest of the organism alive But n an environment.

Re: How AI knows things no one told it

#12
post #8
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

It's par for the course for the modern Scientific American which has fallen very very very far from its origins.

Wait until you learn about Forbes allowing anyone with $500 to be a contributing author and punishing literally anything on their site.

Re: How AI knows things no one told it

#13
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

If you invent/introduce made up concepts and rules on the spot ("let shmerple be ..."), which can't possibly be found in its training data, then, from my experience, when queried, LLMs are able to correctly reason most of the time... So it's not just Markov chains regurgitating sentences verbatim from their dataset.

Even if this kind of intelligence is just statistics, does it really matter? If it quacks like a duck, it's a duck. Maybe our own brains are nothing more than overrated statistical machines?

The only issue I see with the hype is when people attempt to anthromorphize it.

Re: How AI knows things no one told it

#14
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

Remember the crypto hype train? Turned out a lot of journos were being paid in funny money tokens to hype and pump, and a lot of conflicts of interests abounded in general with peddling services someone they knew had investment in. Welcome to the media. It's always been fickle when it comes to the potential to make money.

Also very clearly a lot of people left holding the bag with crypto and are trying to resuscitate it with hype.

Re: How AI knows things no one told it

#16
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

We just had this discussion a few days ago: https://news.ycombinator.com/item?id=35868065. It does appear to be a case of mis-used measurements rather than true emergence.

Re: How AI knows things no one told it

#17
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

What does it mean to be “more than statistics”? Is there anything that cannot be described as a statistic?

I think the part of the article that the parent comment is disagreeing with is:

> “It is certainly much more than a stochastic parrot, and it certainly builds some representation of the world—although I do not think that it is quite like how humans build an internal world model,” says Yoshua Bengio, an AI researcher at the University of Montreal.

> At a conference at New York University in March, philosopher Raphaël Millière of Columbia University [...] went a step further and showed that GPT can execute code, too, however. The philosopher typed in a program to calculate the 83rd number in the Fibonacci sequence. “It’s multistep reasoning of a very high degree,” he says. And the bot nailed it. When Millière asked directly for the 83rd Fibonacci number, however, GPT got it wrong: this suggests the system wasn’t just parroting the Internet. Rather it was performing its own calculations to reach the correct answer.

> This impromptu ability demonstrates that LLMs develop an internal complexity that goes well beyond a shallow statistical analysis. Researchers are finding that these systems seem to achieve genuine understanding of what they have learned.

Re: How AI knows things no one told it

#18
post #13
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

If you invent/introduce made up concepts and rules on the spot ("let shmerple be ..."), which can't possibly be found in its training data, then, from my experience, when queried, LLMs are able to correctly reason most of the time... So it's not just Markov chains regurgitating sentences verbatim from their dataset. Even if this kind of intelligence is just statistics, does it really matter? If it quacks like a duck,…

Yeah, it's bizarre.

Are we not simply employing statistics when we deduce that yes, if we release our grip, the smartphone will fall to the floor?

You wouldn't have to ever see a phone drop in order to know that, and neither would you have to study or know of the terminology of gravity.

It comes from the statistical knowledge that all things fall when not blocked.

Re: How AI knows things no one told it

#19
post #4

Exceptionally unconvinced that it's more than statistics, and frankly unhappy that pop Sci media is being this uncritical of claims it's emergent intelligence.

Same can be said for human intelligence as well, just we are just more efficient in number of tokens we digest

Re: How AI knows things no one told it

#20

Earlier quoted context omitted.

What would it mean exactly to be "more than statistics"? Does the human brain qualify?

Yeah, the brain is alive and is trying to keep the rest of the organism alive But n an environment.

One could reasonably say that's merely what the statistics are doing, not evidence to deny that the brain is just statistics.
Post reply on HN