>So what context would cause me to seriously consider the possibility that engineers had created a computer program that is conscious and an intentional user of language? Let me outline one potential sequence of steps. The first requirement is that the computer program has a body (either physical or virtual) and sense organs; there are many reasons for this, but for the purposes of this discussion the most relevant o…
The body itself has little effect on the mind other than the inputs from nerves and chemical and hormonal changes. These inputs are analogous to tokens and parameters for an LLM. You could theoretically reserve some tokens to be used as “physical” or “emotional” sensations that would affect the functioning of the model.
Artificial intelligence is not conscious – Ted Chiang
171–180 of 1001 posts
Re: Artificial intelligence is not conscious – Ted Chiang
#172I think about Star Trek: TNG’s “Measure of a Man” a lot lately. We can be so confident to decide what is and isn’t alive from vibes alone. The conclusion I’m currently at is that I don’t know and probably can’t ever know. Maybe you’re all philosophical zombies. Maybe I am one too! But at some point we will get close enough that it hopefully becomes obvious that we must tread carefully. The entire episode is incredibl…
Easily one of my top 10 favorite episodes. The judge broached on the subject of what makes us distinct from Data (e.g. machines w/great heuristics) - the existence of a soul. Or rather, I'd like to think, in the words of CS Lewis, that we are a soul with bodies attached.
Re: Artificial intelligence is not conscious – Ted Chiang
#173I think Chiang is right about this, but there is a related philosophical mystery. The trend from Deep Blue to AlphaGo to LLMs solving Erdos problems suggests that Peter Watts was onto something when he wrote Blindsight. Reasoning ability is apparently independent of consciousness? We haven't really come to grips with that yet. What does it mean if nothing we write proves anything about anyone's consciousness?
Re: Artificial intelligence is not conscious – Ted Chiang
#174If you create a simulation of a brain (or "mind"), is it really possible for it to be conscious? It may certainly simulate consciousness, but it would be as conscious as the computer is wet.
Re: Artificial intelligence is not conscious – Ted Chiang
#175We Don’t Have A Testable Definition Of Consciousness Thanks for coming to my TED talk.
Re: Artificial intelligence is not conscious – Ted Chiang
#176[flagged]
Re: Artificial intelligence is not conscious – Ted Chiang
#177I always find the minimizing view of consciousness a bit uninspiring. Like we need to be unique. I've yet to find a reason why it couldn't be the opposite, way more things are conscious than we've been led to believe. What if consciousness appears out of any system that is actively persisting through effects caused by itself? That might be a forest, or outside the realm of the living, a company. An ant colony, or a p…
Re: Artificial intelligence is not conscious – Ted Chiang
#178> We don’t need to fully understand the nature of consciousness to definitively say that certain things are not conscious, and conversational transcripts fall in that category. Well said. I think it is obvious and it has been obvious from the start that next token predictors are not conscious. Of course the extremely predictable clapback from AI-psychosis enjoyers is typically "you're just a next token predictor too!…
Re: Artificial intelligence is not conscious – Ted Chiang
#179Earlier quoted context omitted.
> I honestly don’t know what it even means to be conscious > subjugate other cultures (assuming you mean they're not conscious in other's minds) Have you ever considered you might be a philosophical zombie? [0] [0] https://en.wikipedia.org/wiki/Philosophical_zombie
I can live with that.
I'd ask what it's like, but of course you wouldn't be able to tell me.
Re: Artificial intelligence is not conscious – Ted Chiang
#180I think about Star Trek: TNG’s “Measure of a Man” a lot lately. We can be so confident to decide what is and isn’t alive from vibes alone. The conclusion I’m currently at is that I don’t know and probably can’t ever know. Maybe you’re all philosophical zombies. Maybe I am one too! But at some point we will get close enough that it hopefully becomes obvious that we must tread carefully. The entire episode is incredibl…
Easily one of my top 10 favorite episodes. The judge broached on the subject of what makes us distinct from Data (e.g. machines w/great heuristics) - the existence of a soul. Or rather, I'd like to think, in the words of CS Lewis, that we are a soul with bodies attached.