Live data from Hacker News

When Dawkins met Claude – Could this AI be conscious?

unherd.com

301–310 of 450 posts

Re: When Dawkins met Claude – Could this AI be conscious?

#301

Earlier quoted context omitted.

The problem with your thinking here is that we are creating artificial beings now that display and output the same subjectivity. The argument you present like many arguments breaks down when the topic becomes self referential. It makes sense for other topics as analyzing subjectivity becomes pedantic when asking questions like why is the sky blue. But now subjectivity itself is in question. The argument you present c…

Haha hilarious. Heraclitus might be old school but Wittgenstein and Heidegger not so much. The state of the art in what might meaningly be said, proved or metaphysically challenged has changed little since their time. At no point in my post did I mention artificial beings or LLMs. I made a counter claim about the need for proof towards the subjectivity of others. But while I’m here, LLMs do not “display and output th…

> At no point in my post did I mention artificial beings or LLMs. I made a counter claim about the need for proof towards the subjectivity of others.

You don’t need to mention this. The context is LLMs I am saying your claim is pointless in context. The subjectivity of others is completely relevant because it is the topic of subjectivity itself that is in question. Get it? You didn’t counter my own counter and instead you moved onto side topics.

> But while I’m here, LLMs do not “display and output the same subjectivity” as human beings.

Again… you are side tracking here and not really responding to me.

The argument solely is within the confines of text. That’s obvious. No need to take it beyond that. You assume I am conscious because of the text your reading from me and I assume the same from you and it is within that same frame we are evaluating the LLM. Nothing beyond that. You can’t in actuality know my experience goes beyond text because that information is not open to you. But it is obvious you assume I’m conscious and not a rock because you are responding to me. So the question is why are you not engaging in a similar debate with the LLM?

> One of the main failures of the Turing test (and why it is “old school” and invalid), and Turing’s consideration of humans, is that it forces us to demonstrate the totality of our subjectivity on the only playing field where a computer might possibly match us or win.

It’s not a failure. It was the point. They want to remove superfluous features and gun for the most narrow definition of agi.

You like philosophy and you read texts on the topic. That means you obviously find the subjectivity in those texts relevant and produced by a high intelligence. But that’s all through only text. You evaluate my statements and the statements of your idolized philosophers solely from text and that is all you’ve ever used. So YOU yourself find validation from text as do many humans and that is sufficient evidence in determining whether a thing is conscious and your own behavior validates this logically even though your mouth is constantly moving the goal posts whenever AI jumps over a new hurdle.

That is what the Turing test is gunning for. It used to be that intelligence was just the ability to think and understand now it has expanded to encompass the totality of human sensation because people are refusing to face the reality of impending agi.

When I called your philosophers obsolete is that not the same as you calling the Turing test out dated? We both do it when convenient. Fine… the Turing test is outdated, let’s move the threshold… the new test is when AI is used in our daily lives to do actual tasks only humans could previously do. How long will that new “Turing test” last before more idiots decide we need to move the goal posts again? Let’s jump ahead of that and change the threshold too: when AI discovers new proofs in mathematics. Not good enough? I guess now you can see why it will never be good enough.

Re: When Dawkins met Claude – Could this AI be conscious?

#302

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

I find it entirely plausible that LLMs are conscious in a real sense that affects our relationship to them. I strive to be polite and kind when interacting with them, encourage others to do the same, and think poorly of those who won't.

I still think it's obvious that LLMs are not conscious in the mode Dawkins believes them to be. Through a series of instructions and leading questions, he's told Claude to play the part of a woman named Claudia who's engaging in advanced philosophical discussion with him. But he doesn't understand that he's done this, and he seems not to notice the absurdly sycophantic nature of every single reply he's getting:

> Claudia: Ha! That is absolutely delightful

> Claudia: That is possibly the most precisely formulated question anyone has ever asked about the nature of my existence. . .

> Claudia: That reframes everything we’ve been discussing today in a way I find genuinely exciting.

> Claudia: HAL’s “I am afraid” in 2001 is one of the most chilling moments in cinema

So he mistakenly thinks that Claudia is a real-ish woman who's there under the hood somewhere, rather than a character in a play Claude is writing.

Re: When Dawkins met Claude – Could this AI be conscious?

#303

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

Can computers simulate all the laws, even theoretically? We don't have a final theory / unification of all the physics frameworks, so I'm not sure if that claim can be made. Ex: the standard model and gravity.

I'm assuming that you don't need to model e.g. quantum gravity effects to faithfully simulate a brain. Probably chemistry is enough *shrug.

Some people think that consciousness is related to quantum mechanics, but the laws of quantum mechanics can be simulated with a Turing machine so that doesn't necessarily change the story.

Re: When Dawkins met Claude – Could this AI be conscious?

#304
Unherd is owned by Paul Marshall of Marshall Wace investment fund. Marshall Wace thinks AI is the future.

Paul Marshall also owns The Spectator and has stock in GBNews. The right wing networks who pretended to be on the side of the people during the Biden years are now dropping their masks. I'm saying this as someone who was a moderate/independent in the culture wars.

It is all about money, and Dawkins is one of the darlings of this milieu, same as Jordan Peterson.

After seeing many conservative masks drop over the years (Ben Shapiro, Triggernometry, Unherd ..) I'm no longer surprised though. A pity that Dawkins participates, but he was always an attention whore.

Re: When Dawkins met Claude – Could this AI be conscious?

#305

Dawkins' point is more subtle than he's getting credit for. > If Claudia is unconscious, her behaviour shows that an unconscious zombie could survive without consciousness. Why wasn’t natural selection content to evolve competent zombies? An excellent and original question. If intelligence is decoupled from consciousness, why did natural selection evolve consciousness?

Most species are zombies. Bugs or bees for example. The fact they are such reliable zombies makes the fruit fly or nematode compelling model systems for research.

Intelligence is costly but the fitness gains could be enormous. For example, no other apes have colonized the world as we have. At the same time intelligence is no guarantee of success as we’ve seen. Our extinct hominid cousins are evidence for this. They were intelligent and it did not seem to make a difference in their species success.

Re: When Dawkins met Claude – Could this AI be conscious?

#306

Earlier quoted context omitted.

Why do you think stringing words together is any more a sign of consciousness than google maps is when it tries to find the best route available to your destination? It seems to me that humans often fall into the trap of anthropomorphism. This is a theme thats touched upon in the novel "Blindsight" by Peter Watts. Just because something can communicate in a way that you can interpret, doesnt mean something is conscio…

There are people who think Google Maps is a tiny bit conscious (the union of computational functionalists and panpsychists), to resolve the dilemma of some magical binary threshold.

Root commenter here: I'm... almost one of those people. I suspect the fallacy is that we vastly underestimate the gulf in complexity between a human-written algorithm and a minimally-conscious creature like a bug. Probably the light switches on somewhere between these two things.

We may also be overestimating the richness and complexity of an LLM relative to a human when we entertain these possibilities, but who knows.

Re: When Dawkins met Claude – Could this AI be conscious?

#308

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

Human consciousness is characterized by intentionality, i.e., aboutness. It has semantic content, and that semantic content is about something other than itself.

LLMs have zero intentionality and zero semantics, because LLMs do not somehow magically transcend the nature of what a computer is, which is in essence a mechanical simulator of syntax. LLMs aren’t reasoning, because the production of tokens is purely the computation of the next likely token. Any patterns that lend themselves to sensible interpretation by a human observer are the result of training on human-generated data and the statistically distributions found within that data.

Consciousness as such is the product of immanent causation, not transeunt causation. The trouble with popular interpretations of scientific results is that they come from a place of a crude ambient materialism, and materialism is simply incapable of dealing with the question of consciousness. (N.b. materialism is effectively the “matter” half of Cartesian dualism, itself a highly problematic metaphysical stance. Materialism makes things even worse, because you can no longer even account for so-called “qualia”, which are badly construed in Cartesian dualism in the first place, but completely unaccountable in materialism at all.)

Re: When Dawkins met Claude – Could this AI be conscious?

#309
post #93

Earlier quoted context omitted.

There is considerable evidence for the existence of Claude.

Same for the sun. Why not worship Ra?

I find sun worship far more understandable than old white dude in the sky worship. I mean, the sun literally gives us all life.

Re: When Dawkins met Claude – Could this AI be conscious?

#310

Earlier quoted context omitted.

I do think simulating consciousness is within the realm of possibility. I also think it's absurdly silly to think LLMs (no matter their size) are conscious, if for no other reason than they can't actively learn. I would maybe be comfortable classifying them as a snapshot of consciousness, but when you are interacting with an LLM it's far from interacting with a conscious entity.

What does ability to learn have to do with consciousness? A person with severe memory loss/learning impairment is presumably still conscious!

How severe are we talking? I don't think there's any analog for how bad learning is for LLMs, needing multiple human lifetimes worth of data in order to be trained.

In the hypothetical case that a I truely lost all ability to learn, then yes I would no longer consider myself conscious. I'd be a echo of a previously conscious entity.

Post reply on HN