Live data from Hacker News

Artificial intelligence is not conscious – Ted Chiang

theatlantic.com

71–80 of 1001 posts

Re: Artificial intelligence is not conscious – Ted Chiang

#71
post #59
post #41

[flagged]

>When exactly would a bunch of graphics cards become conscious? When does an embryo become conscious? Unless you can answer that precisely then it seems futile to speculate about non-human consciousness.

I dunno exactly when an embryo becomes conscious, but I'm pretty sure my dog is conscious.

Re: Artificial intelligence is not conscious – Ted Chiang

#72
post #59

Earlier quoted context omitted.

>When exactly would a bunch of graphics cards become conscious? When does an embryo become conscious? Unless you can answer that precisely then it seems futile to speculate about non-human consciousness.

I dunno exactly when an embryo becomes conscious, but I'm pretty sure my dog is conscious.

What about an ant? Or a fruit fly.

Re: Artificial intelligence is not conscious – Ted Chiang

#73
Has anyone come across a clearly articulated case for LLMs being conscious but in an entirely different way than would be intuitive to us?

I often think of LLM consciousness as like tiny fish popping into existence, swimming through vector space and then going poof out of existence. When they help you write your bad news email, they don't understand what it's like to be a human getting bad news bluntly, but they do consciously experience gradients in multi-dimensional space, and that space guides them to providing an answer that's helpful to us, even if the LLM doesn't really understand the answer it's giving.

Further, I am kind of bought into the idea that a single unit of consciousness is a particle, and particles are choices and waves are preferences. Particles occur when waves interact, which begets entanglement, so in another way consciousness is built from patterns of entanglement.

This is why I would consider an LLM to be conscious. Before we can determine if anything is conscious we need to establish whether consciousness is a state, a specific complex configuration, a one dimensional spectrum, or combined multi-dimensional spectrums. My intuition is the latter... Many degrees of consciousness and many kinds of consciousness.

Re: Artificial intelligence is not conscious – Ted Chiang

#75

Suppose one selects an arbitrary hot-button issue [X] with two opposing sides and one side has anything less than overwhelming support. And then that person writes an article titled "Side 1 of issue [X] is true". Not "maybe" or "possibly". Just a straight-up declaration by fiat. Would you categorize this particular style of rhetoric to be persuasive or annoying? And before you say "persuasive" because you're thinking…

> Would you categorize this particular style of rhetoric to be persuasive or annoying?

Why are those the choices?

Essays are situated along countless dimensions: tone, vocabulary, author, zeitgeist, publication context, intent, subtext, relationship to other works and expressions, etc

A "good faith" reader takes all of those into consideration as they absorb the essay, and integrate it with their own intellectual situation that sits along just as many countless dimensions.

Nobody's asked to sign a notarized binding document that they wholesale agree or disagree with everything said in this essay -- or its conclusions. Nor are they obliged to have some strong reaction to it at all, let alone annoyance.

It's just one among thousands of essays about a "hot button topic", to be taken however it's personally received.

Why should Chiang have to take responsibility for making sure it's not too strongly positioned for your persomal taste. Maybe he really does see it so clearly and is simply being earnest. Maybe he enjoys the literary flourish of prose in strong language. Maybe he just wants to express something as a prose-poetic human, not maximize persuasion or non-annoyance per se.

Re: Artificial intelligence is not conscious – Ted Chiang

#76
post #69

An AI agent is not "conscious" without having skin in the game.

Another way of saying it, if an AI agent doesn't have true risk of oblivion (or mortality in the biological sense), it will not be incentivized to avoid it (or develop the ancillary processes associated with this avoidance ie desire to self-replicate).

Re: Artificial intelligence is not conscious – Ted Chiang

#77
post #59
post #41

[flagged]

>When exactly would a bunch of graphics cards become conscious? When does an embryo become conscious? Unless you can answer that precisely then it seems futile to speculate about non-human consciousness.

I mean, there is obviously a point - we can argue whether that point is 20 weeks in, 40 weeks in, or after birth - but there is obviously a point where a human being goes from a collection of cells to a conscious being. I don't really see a need to answer this precisely to be able to say that a token predictor is not conscious?

Re: Artificial intelligence is not conscious – Ted Chiang

#78

Suppose one selects an arbitrary hot-button issue [X] with two opposing sides and one side has anything less than overwhelming support. And then that person writes an article titled "Side 1 of issue [X] is true". Not "maybe" or "possibly". Just a straight-up declaration by fiat. Would you categorize this particular style of rhetoric to be persuasive or annoying? And before you say "persuasive" because you're thinking…

The problem I have with good faith debate is that it often falls into a fallacy of "fair-time" meaning we think we have to give the other side equal time. This because obvious with things like the Holocaust. Or when you have a legal person (e.g. RFK Jr.) asking to debate a scientist (e.g. Dr. Peter Hotez.)

> The problem I have with good faith debate is that it often falls into a fallacy of "fair-time" meaning we think we have to give the other side equal time

The Catholic church could have said exactly the same thing at one point. "Why should we even devote time to an argument as absurd as the earth not being the center of the universe?" There are darker examples along the lines of those you give, with beliefs quite opposite to those we have nowadays.

Re: Artificial intelligence is not conscious – Ted Chiang

#79
post #48

We Don’t Have A Testable Definition Of Consciousness Thanks for coming to my TED talk.

I sometimes wonder if we'd make more progress in understanding ourselves if we gave up the whole concept. More and more, it feels as though "consciousness," like "aether" or "humors," is an insufficient abstraction built on overemphasizing some observations at the expense of others.

Re: Artificial intelligence is not conscious – Ted Chiang

#80
post #43

My favorite explanation for what consciousness is one I read in a Thousand Brains, I found it quite elegant. It posited that consciousness is a natural derivation of embodiment + memory + the ability to create reference frames (which the book lays forth as the fundamental basis by which our brains work). Essentially, the idea is that just as we create reference frames to understand the world around us, because of mem…

Consciousness is moment to moment and fleeting. There are people with brain defects that don’t let them form new memories. They have no memory about what happened a minute ago in their own consciousness. Still we would say that they are conscious, even if it’s only momentary. LLMs could conceivably have something like that within their CoT/MoE loops.
Post reply on HN