Live data from Hacker News

Artificial intelligence is not conscious – Ted Chiang

theatlantic.com

221–230 of 1001 posts

Re: Artificial intelligence is not conscious – Ted Chiang

#221

We do not know if Claude is conscious, and we will almost certainly never know. Any strong claim either way is over confident.

We do not know if rocks are conscious and we will almost certainly never know. After all, you can't prove a rock isn't conscious. We don't know what imbues matter with consciousness.

Re: Artificial intelligence is not conscious – Ted Chiang

#222

“Counsciousness” is the ultimate moving goalpost, and historically, it’s been one of humanity’s most effective intellectual weapons. An indefinable black box we intentionally gatekeep to draw an arbitrary line between ‘us’ and ‘them’. I don’t know if AI is conscious or not, and I honestly don’t know what it even means to be conscious. historically, by claiming a monopoly on it, we’ve successfully manufactured the phi…

Can you give some historical examples of people moving the goalposts around consciousness? I agree, perhaps, for aspects of "intelligence" but I can't think of any examples of it with regard to consciousness proper.

The Turing test comes to mind. It no longer being the gold standard for thinking machines.

Re: Artificial intelligence is not conscious – Ted Chiang

#223

Earlier quoted context omitted.

Fancypants autocomplete cannot be conscious. It's just echoing previous human experiences, which make it sound like a person. It is not a person. It is an algorithm. There is no mechanism by which it can obtain consciousness. People believing otherwise are fools. People debating this are idiots. I realize these words are harsh, but it's the truth.

[dead]

Can you explain the mechanism that Claude uses to achieve consciousness over, say, a markov chain or autocomplete? It's not enough to say it "could be" conscious without also including a lot of other things I doubt you would want to include.

Also worth mentioning: https://en.wikipedia.org/wiki/Chinese_room

Re: Artificial intelligence is not conscious – Ted Chiang

#224
post #214

I think about Star Trek: TNG’s “Measure of a Man” a lot lately. We can be so confident to decide what is and isn’t alive from vibes alone. The conclusion I’m currently at is that I don’t know and probably can’t ever know. Maybe you’re all philosophical zombies. Maybe I am one too! But at some point we will get close enough that it hopefully becomes obvious that we must tread carefully. The entire episode is incredibl…

Any time I bump into a device that acts like a human I'm going to treat it like a human. Because treating things that act human inhumanely is not something I want to learn how to do.

My instincts are pretty different here.

- I'll try not to swear at/hit a printer: not because I see the printer as having human-like qualities of being capable but complex and unreliable, but because I want to be a person who can control his temper.

- Treating an inhuman thing as human because it can mimic us in some way is not something that I want to do.

Re: Artificial intelligence is not conscious – Ted Chiang

#225

I think about Star Trek: TNG’s “Measure of a Man” a lot lately. We can be so confident to decide what is and isn’t alive from vibes alone. The conclusion I’m currently at is that I don’t know and probably can’t ever know. Maybe you’re all philosophical zombies. Maybe I am one too! But at some point we will get close enough that it hopefully becomes obvious that we must tread carefully. The entire episode is incredibl…

> The conclusion I’m currently at is that I don’t know and probably can’t ever know.

I think about this quote often, straight from Data's voice module in another episode:

'The most elementary and valuable statement in science, the beginning of wisdom, is, "I do not know".'

Re: Artificial intelligence is not conscious – Ted Chiang

#226
My position:

If some version of panpsychism is true, AIs are plausibly conscious

We don’t know whether panpsychism is true

Therefore, we don’t know whether AIs are conscious

Hence, confident proclamations that they aren’t conscious have dubious validity

Re: Artificial intelligence is not conscious – Ted Chiang

#227

Earlier quoted context omitted.

Yeah, it's kind of mind boggling that Ted Chiang (of all people!) can't imagine intelligence without a body. and the whole thing just begs a lot of questions. Is a car a body? Does an AI situated in a car therefore get to have desires and emotions? Is a taupe box with a webcam attached a body? (For that matter: Is a quadropelegic body a body? Do quadropelegics have desires and emotions? Obviously, yes and yes.) Why i…

> Yeah, it's kind of mind boggling that Ted Chiang (of all people!) can't imagine intelligence without a body. and the whole thing just begs a lot of questions. How can you have a subjective experience without a body? That's the point, in my opinion: your physical/chemical state (body) in a given moment is then translated into the higher abstraction of the emotion. An emotion that *you* feel, because you are self awa…

How can you have a subjective experience without a body?

Some anecdotal data.

Many dreams I have are just of the computer screen of some coding problem. I think the problem could be x, so I try x. But I don't type the keyboard or anything, the code just magically appears as soon as I think of the solution. Then run the code (but no clicking) and it works or not. I feel in the dream success feeling or failure feeling but there is no body at all.

Also I have other dreams where there is no body that I am aware of but not going there in public.

There is no body sensation in these dreams. But dreaming is very much being consciousness as well as feeling emotions. So answering your question its possible to have a subjective experience without a body but whether you needed the body to learn to have that sensation without a body in the first place is unanswered.

I suspect sensory inputs are more important than a body. If that is the case then eyes can be replaced with cameras, ears with microphones etc. Text input is just another sensory input.

Re: Artificial intelligence is not conscious – Ted Chiang

#228

Obviously we don't know what makes for consciousness, but it seems extremely likely that it requires some sort of persistent internal state and continuous experience. LLMs don't do either of those things after training.

Is our own experience really continuous? Or maybe we just perceive it as such?

Re: Artificial intelligence is not conscious – Ted Chiang

#229

> My intention is to highlight the fact that LLM conversations are cleverly disguised examples of sentence continuation Regardless of bigger issues, this kind of statement reveals a deep misunderstanding. Problem type does not limit problem complexity. Nor does problem type limit solution complexity or power. If a machine has to learn to understand humans to complete text, then that is what it has to do. And there is…

"If a machine has to learn to understand humans to complete text, then that is what it has to do."

But the machine doesn't have to understand humans to do that. It gets trained on a whole bunch of sentences and then it is able to complete text. You could maybe claim that it "understands" the text but even that's a stretch.

Post reply on HN