Live data from Hacker News

Artificial intelligence is not conscious – Ted Chiang

theatlantic.com

931–940 of 1001 posts

Re: Artificial intelligence is not conscious – Ted Chiang

#931
post #898

Everyone but me might be a philosophical zombie. But I still treat them with respect. I do this because I like living in a world that gives us the benefit of that doubt. It can't hurt to say "please" and "thank you" to an LLM.

If you thank a chatbot you may as well also thank chairs, utensils, the floor you walk on, the air you breathe

Careful there! You almost sound like you're suggesting a prayer.

Re: Artificial intelligence is not conscious – Ted Chiang

#932
post #909
post #424

Earlier quoted context omitted.

Not the model though. The model really only takes input text and produces output text. Memory within a conversation is achieved by the harness adding the conversation (or parts of it) to the input text. The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does.

Wait until you hear about the hippocampus!!! [1] I don't think physical integration within one contained is relevant to system level behavior. [1] https://en.wikipedia.org/wiki/Neuroanatomy_of_memory

I had heard (o rather, read) about the hippocampus before, but I don’t understand how that relates to my claim that the models have no memory.

Re: Artificial intelligence is not conscious – Ted Chiang

#933
post #385

Earlier quoted context omitted.

> a flaw in the logic [...] mechanism Similar to: "Birds fly, my spinning helical device flies, therefore we've started to replicate how birds fly." > without having to build elements that one expect on a conscious being One of the elements I expect in a conscious being is that you can't rewrite it by changing the introductory paragraph. When it comes to LLMs, almost every "mind" we humans perceive is a fictional cha…

>One of the elements I expect in a conscious being is that you can't rewrite it by changing the introductory paragraph. If we had enough knowledge of the workings of the human brain, you could alter the perception of every single memory you've ever had. And limited versions of this already happen all the time. Human memory is notoriously unreliable for a reason. Are you aware of the Recovered Memory Therapy Scandals…

[deleted]

Re: Artificial intelligence is not conscious – Ted Chiang

#935

> My intention is to highlight the fact that LLM conversations are cleverly disguised examples of sentence continuation Regardless of bigger issues, this kind of statement reveals a deep misunderstanding. Problem type does not limit problem complexity. Nor does problem type limit solution complexity or power. If a machine has to learn to understand humans to complete text, then that is what it has to do. And there is…

The funny example from a few months ago asked chatgpt 5.2 if one should walk to the car wash because it’s close by, and it answered yes. This shows that it is in fact sentence continuation and not real intelligence or consciousness (whatever that may be). Even the reasoning model answered the same.

Re: Artificial intelligence is not conscious – Ted Chiang

#937

Earlier quoted context omitted.

I didn't make the claim that a model can learn consciousness. Understanding is not consciousness. Their training is all about understanding. There is nothing in their architecture or training that credibly optimizes for rich self-awareness. Given non-persistent experience, non-continuous operation, no ability to build up generalizations and aggregate experience of their own self-awareness over time, they seem to be s…

I think Searle's Chinese Room argument refutes this. LLMs are simply manipulating symbols, they do not have semantic understanding. This is why hallucinations exist. And Searle's argument extends even further than LLMs. You are basically arguing for a functional account of consciousness, but things like this have been debated for literally decades/centuries in philosophy.

>LLMs are simply manipulating symbols, they do not have semantic understanding.

falsify this. Show me a way you'd be able to prove they do/don't, that would work for humans.

Re: Artificial intelligence is not conscious – Ted Chiang

#939

Earlier quoted context omitted.

> I honestly don’t know what it even means to be conscious > subjugate other cultures (assuming you mean they're not conscious in other's minds) Have you ever considered you might be a philosophical zombie? [0] [0] https://en.wikipedia.org/wiki/Philosophical_zombie

I notice certain philosophers seem completely baffled by anyone being interested in the "hard problem" of conscious and things like qualia. A good example is Daniel Dennet. He seems to understand what qualia is but can't seem to understand why there's anything unique about the phenomena. I also see similar opinions expressed here in the comments. I've often wondered if a certain portion of the population are in some…

For someone who only cares about utility of findings, I suppose there's little value in analysing the phenomenology of consciousness. I suspect that for a similar profile of thinkers meditation started being interesting when they saw there's some downstream utility in 'emotional well-being'. So why bother analysing an uncomfortable, hard problem when there's no clear benefit to it?

I just googled 'Daniel Dennet about meditation' and, surprise-surprise: 'Daniel Dennett acknowledged that meditation had practical value for "settling and centering" the mind. While he tried and saw benefits in practices like Transcendental Meditation, he largely discarded the mystical "aura" surrounding it, viewing the practice through his strictly materialist and evolutionary framework'

Re: Artificial intelligence is not conscious – Ted Chiang

#940

> My intention is to highlight the fact that LLM conversations are cleverly disguised examples of sentence continuation Regardless of bigger issues, this kind of statement reveals a deep misunderstanding. Problem type does not limit problem complexity. Nor does problem type limit solution complexity or power. If a machine has to learn to understand humans to complete text, then that is what it has to do. And there is…

Come on, I invented parts of this technology at Google and am baffled why this is debated. We discovered math that decodes data storage in langauge and is able to use sophisticated continuation cohorts from ALL OF HUMAN RECORDED KNOWLEDGE to respond to you in a call/response model with very good synthesis capabilities. Its super useful, but not life or conciousness. Its a simulated echo from our collective recorded b…

Then people raised $1e12+ on claims that it's conscious. Of course everyone debates it
Post reply on HN