Live data from Hacker News

What happens when people don't understand how AI works

theatlantic.com

351–359 of 359 posts

Re: What happens when people don't understand how AI works

#351
post #75

Earlier quoted context omitted.

A lot of the claims of usefulness evaporate when tested. The word useful has many meanings. Perhaps their only reliable use will be the rubber duck effect.

Not for me they haven't.

Anecdotes unfortunately are not data :/

Re: What happens when people don't understand how AI works

#352
post #91
post #75

Earlier quoted context omitted.

A lot of the claims of usefulness evaporate when tested. The word useful has many meanings. Perhaps their only reliable use will be the rubber duck effect.

> A lot of the claims of usefulness evaporate when tested In your personal experience? Because that's been my personal experience too, in lots of cases with LLMs. But I've also been surprised the other way, and overall it's been a net-positive for myself, but I've also spent a lot of time "practicing" getting prompts and tooling right. I could easily see how people give it try for 20-30 minutes, not getting the resul…

Anecdotes unfortunately are not data :/

Re: What happens when people don't understand how AI works

#353

Earlier quoted context omitted.

Having studied those things I can say that from their perspective “what’s the difference?” is an entirely legitimate question. Boldly asserting that what LLMS do is not cognition is even worse than asserting that it is. (If you dig deep into how they do what they do we find functional differences, but the outcome are equivalent) The butlerian view is actually a great place to start. He asserts that when we solve a pr…

> Boldly asserting that what LLMS do is not cognition is even worse than asserting that it is. That's the issue I was driving at. The machine is so convincing. How can we say what it does is not "thinking" when it seems to be breaking down a query like a human does. The distinction between what an AI is and what an LLM is - is so thin that most of us will be ignorant and combine the two because you really need to see…

"It still produces more or less what other humans produce."

But it doesn't ... and it's important to understand why not.

Re: What happens when people don't understand how AI works

#354
post #232

Earlier quoted context omitted.

I've tended to agree with this line of argument, but on the other hand... I expect that anybody you asked 10 years ago who was at least decently knowledgeable about tech and AI would have agreed that the Turing Test is a pretty decent way to determine if we have a "real" AI, that's actually "thinking" and is on the road to AGI etc. Well, the current generation of LLMs blow away that Turing Test. So, what now? Were we…

There's this funny thing I've noticed where AI proponents will complain about AI detractors shopping around some example of a thing that AIs supposedly struggle with, but never actually showing their chat transcripts etc. to try and figure out how they get markedly worse results than the proponents do. (This is especially a thing when the task is related to code generation.) But then the proponents will also complain…

"Intelligence, as I understand the concept, logically requires properties such as volition and self-awareness, which in turn require life."

It doesn't logically require that and you can't provide any sort of logical argument for the claim. And what the heck is "life"? Biologists have a 7-prong definition, and most of those prongs are not needed for intelligence, "volition" whatever the heck that is, or self-awareness.

Re: What happens when people don't understand how AI works

#355
post #282
post #232

Earlier quoted context omitted.

I've tended to agree with this line of argument, but on the other hand... I expect that anybody you asked 10 years ago who was at least decently knowledgeable about tech and AI would have agreed that the Turing Test is a pretty decent way to determine if we have a "real" AI, that's actually "thinking" and is on the road to AGI etc. Well, the current generation of LLMs blow away that Turing Test. So, what now? Were we…

> I expect that anybody you asked 10 years ago who was at least decently knowledgeable about tech and AI would have agreed that the Turing Test is a pretty decent way to determine if we have a "real" AI The "pop culture" interpretation of Turing Test, at least, seems very insufficient to me. It relies on human perception rather than on any algorithmic or AI-like achievement. Humans are very adept at convincing themse…

It's not a "pop culture" interpretation, it's what Turing actually wrote in his 1950 paper "Computing Machinery and Intelligence" where he described his "imitation game", first framing it as a man trying to convince judges that he, not a woman he was competing against, was the woman. It was all about human perception--if some large fraction of human judges were fooled then the man (or the computer, in the shifted version of a computer trying to convince judges that it was the human) won. And the computer winning was operationally defined as the computer being able to think. The flaws in this are glaring.

Re: What happens when people don't understand how AI works

#356
post #141

Earlier quoted context omitted.

The terminology is so confusing in AI right now. I use LLMs, I enjoy them, I'm more productive with them. Then I go read a blog from some AI devs and they use terms like "thinking" or similar terms. I always have to ask "We're still s stringing words together with math right? Not really thinking right?" The answer is always yes ... but then they go back to using their wonky terms.

I personally love LLMs and use them daily for a variety of tasks. I really do not know how to “fix” the terminology. I agree with you that they are not thinking in the abstract like humans. I also do not know what else you would call “chain-of-thought”. Perhaps “journaling-before-answering” lol. It’s basically talking out loud to itself. (Is that still being too anthropomorphic?) Is this comment me “thinking out loud…

Chain of thought is what LLMs report to be their internal process--but they have no access to their internal process ... their reports are confabulation, and a study by Anthropic showed how far they are from actual internal processes.

Re: What happens when people don't understand how AI works

#357

Earlier quoted context omitted.

Thinking in humans is prior to language. The language apparatus is embedded in a living organism which has a biological state that produces thoughts and feelings, goals and desires. Language is then used to communicate these underlying things, which themselves are not linguistic in nature (though of course the causality is so complex that the may be _influenced_ by language among other things).

Agreed. Many animals without language show evidence of thinking (e.g. complex problem solving skills and tool use). Language is clearly an enabler of complex thought in humans but not the entire basis of our intelligence, as it is with LLMs.

LLMs have no intelligence or problem solving skills and don't use tools. What they do is statistically pattern match a prompt against a vast set of tokenized utterances by humans, who do have intelligence and complex problem solving skills. If the LLM's training data were the writings of a billion monkeys banging on typewriters, any appearance of intelligence and problem solving skills would disappear.

Re: What happens when people don't understand how AI works

#358
post #340

Earlier quoted context omitted.

You say that "I don't believe LLMs have become sentient" nor contemplate. But what is the basis for your belief in this? I would think than an atheist would be more likely to have opposite beliefs. I also concede that a "form" of intelligence/sentience could emerge. Presently the form is called "artificial," I'd say. And you're right... not all scifi argues machine evolves to humanity. I meant to refer to that body o…

Thanks for the respectful reply. We agree on scifi! As for atheism: it's merely the lack of belief that god exists (or in some definitions, the active belief that it doesn't exist). Nothing else, nothing more. Individual atheists may believe some other things, or not. I believe some kind of intelligence could arise again, much like ours arose "out of nonintelligence". I just don't think this is it -- LLMs are very im…

How do we prove humans are?

Re: What happens when people don't understand how AI works

#359
post #21
post #2

Someone said, "The AI you use today is the worst AI that you will ever use."

Is the internet today better than it's ever been? I can easily imagine LLMs becoming ad-riden, propagandized, cloudlfare intermediated, enshittified crap the way most of the internet has.

I was going to come back here and say "what about transatlantic flight, which has gotten slower?" --- but your point is more relevant, more immediate, more impactful.

I do believe the LLMs we're using today are the best they're going to be - for the reasons you've highlighted.

Some superior tech might displace them, but LLMs as they are seem much more likely to get worse.

I'm encouraging people to make any important queries right now and save the results. For example "which books should i read on X" - right now you get good answers, in the future it'll be enshittified.

Post reply on HN