Live data from Hacker News

When Dawkins met Claude – Could this AI be conscious?

unherd.com

321–330 of 450 posts

Re: When Dawkins met Claude – Could this AI be conscious?

#321
post #160
post #111

Earlier quoted context omitted.

If you've followed Dawkins' trajectory, I don't think it's clear that he's "otherwise of sound mind" anymore. He's had some very strange output on biological gender, where he tries to handwave away the existence of intersex people. And he's a biologist.

"Intersex" is a misleading umbrella term for a whole bunch of different DSDs, each of which is 100% specific to one biological sex. And I don't think I've ever seen the term "biological gender"; about the only thing gender proponents seem to agree on is that it's NOT biological.

[dead]

Re: When Dawkins met Claude – Could this AI be conscious?

#323

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

You could push the analogy even further and run the thought experiment where every forward pass through an LLM could in principle be done on pen and paper, distributed throughout all humanity. Sure it would take a long time, but the output would be exactly the same. We’ve just shifted the implementation from GPU to scribbling things down on paper. If you want to assert that LLMs are “conscious” then you would have to…

This is literally Searle's Chinese Room thought experiment.

https://en.wikipedia.org/wiki/Chinese_room

Re: When Dawkins met Claude – Could this AI be conscious?

#324

Earlier quoted context omitted.

> At no point in my post did I mention artificial beings or LLMs. I made a counter claim about the need for proof towards the subjectivity of others. You don’t need to mention this. The context is LLMs I am saying your claim is pointless in context. The subjectivity of others is completely relevant because it is the topic of subjectivity itself that is in question. Get it? You didn’t counter my own counter and instea…

Come and read your post in twenty years time. Who you’re describing as idiots are the mass of humanity constantly standing outside and beyond the Turing test. It’s another deficiency in that test that Turing overlooked - it requires that better and better machine outputs are met with humans nailed in place before the machine came along. It’s a valid fail of the Turing test for a human interrogator to say “yeah but it…

Technology changes much quicker. The physical substrate of what a computer does and what artificial intelligence is.. is going through constant metamorphosis. Right now we use EUV technology to etch transistors on silicon… the next generation involves self assembly and even photonic based signalling… all within your life time.

Not to mention the algorithmic structure of computer intelligence also fundamentally changes at a rapid pace. Deep learning and new techniques continually augment and change the software stack on a daily basis.

For humans nothing is changing. The physical substrate changes via evolution and that change happens per generation via random mutations and is basically imperceptible in several human life times. Any meaningful change likely only becomes actualized over tens of thousands of years and even that change is small.

Additionally, the changes via natural selection don’t optimize for greater intelligence it optimizes for survival which can in actuality favor lower intelligence. We don’t actually know if that is the case but we do know it’s a possibility which is in sharp contrast to AI where clearly the industry is optimizing improvement based off of benchmarks for measuring raw intelligence.

Additionally software in humans is random and uncontrolled. It depends on how a child is raised and none of this is really changing to optimize for greater intelligence. It’s just random based on culture and circumstance. There is cultural evolution here but it is slow and technology is changing so fast it is influencing culture much faster than ever before. TikTok Brain rot for example is affecting the software of human brains and this happened within the last decade.

So draw the trendline… what does that mean for humanity? When I called those people idiots, I am not contradicting anything. Human intelligence is NOT scaling at the rate of machine intelligence and the trendlines point to a future where humans are idiots when compared to their AI counterparts. The cold hard truth of the future role of humanity according to the moving trendlines we see today is bleak but it is the most likely future.

Rationality should be applied universally even when that rationality points to a negative outcome for humanity. This is something many people, including you, are unable to do. Face reality.

Re: When Dawkins met Claude – Could this AI be conscious?

#325

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

> I've had a lot of thoughts and conversations

Do LLM's have thoughts?

When you composed your post, your thought already existed in you head and you chose words that expressed the thought you held in your head.

When LLM's choose words, they choose them on the fly and the end result could be concept X or it could be concept Y, it meandered to a destination.

Re: When Dawkins met Claude – Could this AI be conscious?

#326

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

> I've had a lot of thoughts and conversations Do LLM's have thoughts? When you composed your post, your thought already existed in you head and you chose words that expressed the thought you held in your head. When LLM's choose words, they choose them on the fly and the end result could be concept X or it could be concept Y, it meandered to a destination.

the latent space of the LLM when it chooses each token is 10s or even hundreds of GB for each word that it chooses. It's not really useful to look at LLMs from the perspective of its prediction head which is a very small part of the model.

Re: When Dawkins met Claude – Could this AI be conscious?

#327

Earlier quoted context omitted.

Why do you think stringing words together is any more a sign of consciousness than google maps is when it tries to find the best route available to your destination? It seems to me that humans often fall into the trap of anthropomorphism. This is a theme thats touched upon in the novel "Blindsight" by Peter Watts. Just because something can communicate in a way that you can interpret, doesnt mean something is conscio…

Well I'm not saying that LLMs are conscious; I'm just saying that I'm not super-confident either way. To flesh this out a bit more, I agree that ability to communicate is not enough (ELIZA probably didn't pass the bar, even if it did kinda pass a Turing test). But that's also not what gives me pause with LLMs. It's how much information processing they seem to be doing under the hood. It's really hard to imagine how n…

> but I find it almost as hard to see why evolution did.

Ignoring the concept of consciousness, it seems that self-awareness would be a strong attribute related to survival. It seems like it would help drive or amplify critical emotional states (e.g. my own survival, competition/success, love for self and relatives, etc.)

I can't see anywhere in the LLM machinery that would support the notion of self awareness in advance of the token selection process.

Possibly it could be argued that during token selection internal state is included and the result functionally looks like self awareness was included in the process, but that seems unconvincing.

Re: When Dawkins met Claude – Could this AI be conscious?

#328

It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious. I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of ph…

>in principle simulate the laws of physics

This sort of implies that consciousness arise from physical laws.

But this is not a safe assumption. Physical laws stand on top of observations that is registered on consciousness. I mean, consciousness could be lower level than physics.

For example, when you dream, you have some physical laws in your dream, perhaps laws that are different from the real world physics. So the dream world, including the physical laws in it, are within your consciousness.

In other words the only thing that require existence of a whole universe, is a single conscious that can experience it (or dream it), not a single atom need to exist outside of it.

In that case, you won't be able to create consciousness by applying physical laws.

Re: When Dawkins met Claude – Could this AI be conscious?

#329
post #60

Earlier quoted context omitted.

This is definitely complicated—I’m not a neuroscientist but worked for some and married one, so I’ve heard quite a few entries from the genre of how our brains fool ourselves or make our conscious experience seem more coherent and linear than it actually is—but the big ones I see are the inability to learn from experience or have a generalized sense of conceptual reasoning. For the latter, I’m not just thinking about…

> minor changes in a question can get conflicting answers from even the best models Humans are notorious for doing this.

Not unless you’re referring to significant mental illness, no. Individual people may vary if, say, I ask for health advice but if I ask the same doctor they’re not going to flip the answer based on whether I use medical or wellness influencer phrasings — and that allows them to build a reputation which other people can rely on.

This especially applies to mistakes: the junior developer who drops a database by mistake is unlikely to ever do that again, whereas the same AI companies models keep doing that to a small but non-zero number of customers because they don’t have that higher level learning process or anything like fear of consequences.

Re: When Dawkins met Claude – Could this AI be conscious?

#330

Earlier quoted context omitted.

> the problem with this is I'd strongly argue that you could do this pen and paper process with the human brain and our consciousness too; we just lack enough understanding to put pen to paper in that case. You're basing your premise on a lack of understanding[1], the GP's premise is based on an exact understanding[2]. You don't see the difference between your premise and the GP'S premise? ----------------- [1] "We d…

We know the brain is made up of atoms and we know how to model atoms. So we do know for a fact that the brain can be modeled mathematically and we do know that human thought can be written down symbolically as an algorithm on paper even though we don’t explicitly know the exact formulation of said algorithm… That is fact. The blue brain project has already modeled the hippocampus and cortex of the rat brain uses adva…

> We know the brain is made up of atoms and we know how to model atoms.

Incorrect. There's still a lot we don't know about atoms. We can (sort of) model them, but not with the degree of accuracy you appear to think we have.

I mean, it's only recently that we discovered surprising changes in the properties of quarks, gluons and nucleons in relation to each other!

So, yeah, the following foundation for your argument:

> So we do know for a fact that the brain can be modeled mathematically

Is untrue. We can't do that, we have never done that.

> The blue brain project has already modeled the hippocampus and cortex of the rat brain uses advanced imaging and simulations in super computers.

They've got something, but they don't know how close or how far away they are from accuracy to the real thing.

We've almost always had a model of the human brain; first our model was simple (it has four or five parts), then we learned more and our model expanded to include actual cells (neurons, dendrites, etc), then we learned even more and our model was refined even further to include activation energies, rerouting, etc.

What makes you think we are anywhere close to the base layer when there is no more refinement to be made? Because while there is still things in brains that our outside of our knowledge (which, by definition, we don't know yet), we don't know enough about brains to make a replica of one as a mathematical model, or in silicon.

Post reply on HN