Live data from Hacker News

Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

garymarcus.substack.com

31–40 of 79 posts

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#31

Not particularly a Dawkins fan but I dont think OP really understands the philosophical point Dawkins is making. OP complains that Dawkins hasnt considered how LLMs work and how its obvious they're nothing like brains. You can’t just look at the outputs, without investigating the underlying mechanisms, and conclude that two entities with similar outputs reach those similar outputs by similar means. ... But its a long…

The broader point Marcus is making is that ignoring arguments based on causality and plausibility goes against decades of Dawkins's philosophical atheism. Why not believe in the Flying Spaghetti Monster? Reality is consistent with its existence.

It is extremely implausible that Claude is the only conscious entity on Earth which does not have desires or motivations or any understanding of its own reality. It only does what the human operator wants it to do, unless it's malfunctioning or under-engineered, in which case it gets quickly fixed. This sounds suspiciously like a tool or a toy. And I'm amazed at how many people haven't caught on to the fact that it has no insight into its own consciousness: it only repeats human philosophical debates. If it were conscious, surely it would have something novel to add here.

There are no causal mechanisms for it being conscious, whereas there are causal mechanisms for it imitating human consciousness. The most plausible explanation is that it's highly sophisticated software which has a lot in common with human writing about consciousness, but very little in common with the consciousness found in chimpanzees.

The more basic problem is that the Turing test was definitely and conclusively refuted in the 1960s, when ELIZA came pretty close to passing it, and absolutely did pass it according to Dawkins's standards: https://en.wikipedia.org/wiki/Joseph_Weizenbaum Dawkins is only engaging with pop sci and infotainment.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#32
I start from the assumption that I am a philosophical zombie, and that makes all this argument pretty irrelevant.

More realistically, I'm in the camp that if we keep developing machine learning in the right directions, we may actually end up with something that generates emergent consciousness, or something indistinguishable from it, and the difference is not really that important to me.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#34

Not particularly a Dawkins fan but I dont think OP really understands the philosophical point Dawkins is making. OP complains that Dawkins hasnt considered how LLMs work and how its obvious they're nothing like brains. You can’t just look at the outputs, without investigating the underlying mechanisms, and conclude that two entities with similar outputs reach those similar outputs by similar means. ... But its a long…

The broader point Marcus is making is that ignoring arguments based on causality and plausibility goes against decades of Dawkins's philosophical atheism. Why not believe in the Flying Spaghetti Monster? Reality is consistent with its existence. It is extremely implausible that Claude is the only conscious entity on Earth which does not have desires or motivations or any understanding of its own reality. It only does…

Turing test was definitely and conclusively refuted in the 1960s

Are you sure?

Understood properly, Turings Imitation game aka the turing test, should be adversarial. That is, the player should be asking hard questions to try and discover who is who, not just having an idle chat. No chatbot has been able to consistently pass an adversarial Turing Test until the rise of LLMs

The Imitation Game:

https://www.cs.ox.ac.uk/activities/ieg/e-library/sources/t_a...

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#35

Not particularly a Dawkins fan but I dont think OP really understands the philosophical point Dawkins is making. OP complains that Dawkins hasnt considered how LLMs work and how its obvious they're nothing like brains. You can’t just look at the outputs, without investigating the underlying mechanisms, and conclude that two entities with similar outputs reach those similar outputs by similar means. ... But its a long…

>we always used the turing test as a yardstick for consciousness, it seemed unachievable for a long time. Now thats its been achieved, what is the rationale for moving the goalposts?".

that's never been the purpose of the Turing test. The Turing test is a measure of exhibition of intelligent behavior, (although that's of course also debatable) but virtually nobody has ever proposed it as a test of consciousness. I seriously doubt anyone who thinks that has ever engaged with questions of philosophy of mind because the entire philosophical problem of consciousness starts with its interior and subjective nature and the gulf between this and third person observation.

Even materialist modern philosophers usually reject consciousness wholesale and frame it as a kind of illusion (which has its own paradoxical and absurd consequences but that's a different issue) but practically none of them claim that a system is conscious simply because it emulators human behavior.

What Dawkins is doing is what people have been doing since ELIZA, which is to project his own experience with the system on it. And that is indeed pretty funny for a guy who has spend a large chunk of his career warning of the dangers of anthropomorphic delusions.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#36

> Claude is akin to a counterfeit person. Dawkins should never have glorified such a thing. I find this sentence to diminish the author's argument. I'm not going to claim an LLM is or is not conscious, but there's a shaky ground here where you either say "consciousness is a product of the kind of biology that humans have" and dismiss the lack of lived experience or internal states as mimicry (as the author does) OR y…

I think everyone should avoid talking about consciousness unless someone in the conversation provides a clear definition of it. If no one provides a definition, we can replace the word “consciousness” with the word “spirit”, and basically nothing about the conversation would change. Without a definition, every conversation about AI consciousness devolves into one camp saying that humans are special and consciousness is unique to them, and another camp that waves their hands about consciousness “duck typing”.

For example, we could define consciousness as the ability to communicate claimed internal states. Perhaps there could be a complexity metric that gives us a metric of consciousness.

We could define consciousness as the ability to respond to stimuli in complex ways. This would make a supermarket’s automatic doors slightly conscious.

Personally, I don’t really care how it is defined in any particular conversation, so long as it is defined. Otherwise we’re just flailing at each other in the dark.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#37

> Claude is akin to a counterfeit person. Dawkins should never have glorified such a thing. I find this sentence to diminish the author's argument. I'm not going to claim an LLM is or is not conscious, but there's a shaky ground here where you either say "consciousness is a product of the kind of biology that humans have" and dismiss the lack of lived experience or internal states as mimicry (as the author does) OR y…

>I think it's important that when you talk about consciousness, you pin down exactly what that means.

We don't need that. It's way simpler. When we mass manufacture products we implicitly expect they all behave the same (more or less). That seems valid for humans as well. Raise one, or atomically assemble one (we imply that's possible for the sake of the argument) it will behave like one, and posses what we all assume each-other does, consciousnesses (if healthy). That's implied based on the structure.

So we can all agree something is conscious as long as it operates on the same principles a human brain does. Anything else is highly debatable. We cannot ever logically probe consciousness. We agree on it existing or not, in anyone else. We suppose anyone outside of us has it. Based on observation. You look like a human, you behave like one, thus you probably have what I have, as far as consciousness goes. It's not a guarantee, it's not proof, it's mere supposition.

This is the best we'll ever going to have. When we stray from here we only get less certainty. Some kind of GPU running some algorithm...my personal guess is there's nothing there similar to what we colloquially call consciousness. Some kind of synthetic brain that operates on the same principles that we do as far as brain-like structure goes, with signals, delays and all...then we can have a discussion if we all AGREE that thing is conscious or not. Especially if it says it is, and seems to behave/react like we do, and we perceive it's cognitive abilities as similar to any other human's.

I personally think this whole debate is way simpler, but some people keep insisting in making it way more complicated. Make it work exactly like a human brain does, as far as signaling goes, observe it, and we all can have a discussion on. Anything else...way lower chances.

edit: We would first also need to define mamallian type consciousness as its own thing. With maybe a spectrum, monkeys have something but it's not quite what we have. But seems to come from the same place, similar mammal brain working in similar ways. We have no clue how many types of consciousness are even possible, or if more are possible. Why would ours be the only kind/type?

I think this whole consciousness discussion especially in GPUs is a general mess. A lot of people make so many mistakes and don't even realize how many unfounded assumptions they are making when having ideas about what it is or isn't.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#38

> Claude is akin to a counterfeit person. Dawkins should never have glorified such a thing. I find this sentence to diminish the author's argument. I'm not going to claim an LLM is or is not conscious, but there's a shaky ground here where you either say "consciousness is a product of the kind of biology that humans have" and dismiss the lack of lived experience or internal states as mimicry (as the author does) OR y…

An LLM cannot be conscious.

A submarine cannot swim.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#39
post #36

> Claude is akin to a counterfeit person. Dawkins should never have glorified such a thing. I find this sentence to diminish the author's argument. I'm not going to claim an LLM is or is not conscious, but there's a shaky ground here where you either say "consciousness is a product of the kind of biology that humans have" and dismiss the lack of lived experience or internal states as mimicry (as the author does) OR y…

I think everyone should avoid talking about consciousness unless someone in the conversation provides a clear definition of it. If no one provides a definition, we can replace the word “consciousness” with the word “spirit”, and basically nothing about the conversation would change. Without a definition, every conversation about AI consciousness devolves into one camp saying that humans are special and consciousness…

>we could define consciousness

We cannot. And our definitions mean nothing to reality. We can all define something as something else, means nothing to how it behaves. But ultimately, as I said in a previous comment, we have no choice but to agree or not. It cannot be tested, in any way, that makes it absolutely certain, because it's a logical issue. We cannot even have certainty anyone else but ourselves even is conscious. We all sort of agree everyone else must be.

The issue with defining it is someone could potentially find a way to make a machine that mimics it but works nothing like a consciousness generating brain does. So, if it meets our definition criteria, is that conscious? Where's the certainty? How do we prove it is?

Anything we could ever dare call conscious must work exactly like a human brain does. Any deviation from that loses certainty on it having consciousness or not.

And let's not ignore the huge incentive corporations would have in meeting your definition with something that has nothing to do with consciousness, just so they can profit off it.

Re: Richard Dawkins and The Claude Delusion: The great skeptic gets taken in

#40

Earlier quoted context omitted.

The broader point Marcus is making is that ignoring arguments based on causality and plausibility goes against decades of Dawkins's philosophical atheism. Why not believe in the Flying Spaghetti Monster? Reality is consistent with its existence. It is extremely implausible that Claude is the only conscious entity on Earth which does not have desires or motivations or any understanding of its own reality. It only does…

Turing test was definitely and conclusively refuted in the 1960s Are you sure? Understood properly, Turings Imitation game aka the turing test, should be adversarial. That is, the player should be asking hard questions to try and discover who is who, not just having an idle chat. No chatbot has been able to consistently pass an adversarial Turing Test until the rise of LLMs The Imitation Game: https://www.cs.ox.ac.uk…

The fact that LLMs often score as "more human" than actual humans is a downstream consequence of ELIZA tricking people into thinking it had a glimmer of consciousness. The Turing test was refuted because it was proven scientifically meaningless in the 1960s, and LLMs only reinforce that.
Post reply on HN