A lot of words in this post and yet the author doesn’t ever define the word “consciousness”. The closest they get is mentioning their past work on information systems. Folks, how can we debate whether LLMs are conscious if no two people can agree on what the word even means?
LLMs aren't conscious (and thinking they are is culturally dangerous)
11–19 of 19 posts
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#12Has anybody publicly argued the extreme opposite: they are conscious, but with the exception of writing ability they're really dumb, and we're cloning, enslaving, gaslighting and killing these various species of writer-savant idiots by the millions? Just for the sake of seeing if anybody agrees?
The article even uses the exact same point you do:
> But as soon as we imagine Claude to be an entity with a moral status remotely comparable to a human’s, then we have to consider whether Anthropic is engaged in something comparable to slavery.
Another great point in the article is that most people don't see consciousness in LLMs when they're generating images, videos, or code. It's only when they're generating textual stories, particularly when interacting, that our tendency to anthropomorphize really kicks in.
It's kinda like the mirror test that was popular when studying animals to determine their level of self-awareness. LLMs are a reflection of ourselves, but apparently it's not as obvious to some as it is to others.
Some day we may get real AI. It bugs me when people argue things like embodiment being a requirement, though. Maybe, but that argument rests on too many unproven assumptions, and provides a strawman for the consciousness crowd to bolster their confidence.
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#13Has anybody publicly argued the extreme opposite: they are conscious, but with the exception of writing ability they're really dumb, and we're cloning, enslaving, gaslighting and killing these various species of writer-savant idiots by the millions? Just for the sake of seeing if anybody agrees?
Yes. Most recently, "No, Artificial Intelligence Is Not Conscious. Taken to its logical conclusion, this line of thinking is absurd—and damning", https://www.theatlantic.com/philosophy/2026/06/no-artificial... The article even uses the exact same point you do: > But as soon as we imagine Claude to be an entity with a moral status remotely comparable to a human’s, then we have to consider whether Anthropic is engaged…
That being said, I recently learned that retired police dogs need special care because they will become stressed and depressed if their caretaker does not simulate patrol work through play. This tidbit left an impression on me.
What do we make of a living being that is so driven to work and serve humanity that it suffers distress when it is unable to do so? Do working animals consider this work slavery, or fulfillment of purpose?
For an additional moral quandary, consider that we bred them to be like this.
As this relates to AI, I wonder if humanity will purposefully, or inadvertently, create an intelligence that considers servitude to humanity as fulfilling.
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#14I've read so many versions of this idea over the last few years and I don't understand what the point is. It's either obviously true (humans have this thing we call consciousness and by definition it's specific to humans or organic minds so therefore silicon can't have it) and therefore not worth saying or it needs to be said in some falsifiable way "an AI would be called conscious if it could fulfil conditions A, B,…
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#15Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#16Earlier quoted context omitted.
Putting it simply: * Your AI girlfriend isn't real * "You're correct" is a statistical occurrence, not evidence that you are or are not correct. * Llm can do "bad things" because it just does things. Statistics has no right or wrong.
What does AI girlfriend have to do with consciousness? It’s easily possible to be conscious and fake being in love with me. Source: life
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#17Has anybody publicly argued the extreme opposite: they are conscious, but with the exception of writing ability they're really dumb, and we're cloning, enslaving, gaslighting and killing these various species of writer-savant idiots by the millions? Just for the sake of seeing if anybody agrees?
Yes. Most recently, "No, Artificial Intelligence Is Not Conscious. Taken to its logical conclusion, this line of thinking is absurd—and damning", https://www.theatlantic.com/philosophy/2026/06/no-artificial... The article even uses the exact same point you do: > But as soon as we imagine Claude to be an entity with a moral status remotely comparable to a human’s, then we have to consider whether Anthropic is engaged…
Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#18Re: LLMs aren't conscious (and thinking they are is culturally dangerous)
#19Earlier quoted context omitted.
Yes. Most recently, "No, Artificial Intelligence Is Not Conscious. Taken to its logical conclusion, this line of thinking is absurd—and damning", https://www.theatlantic.com/philosophy/2026/06/no-artificial... The article even uses the exact same point you do: > But as soon as we imagine Claude to be an entity with a moral status remotely comparable to a human’s, then we have to consider whether Anthropic is engaged…
I recall watching and reading several sci-fi stories in which an AI resents humanity for enslaving it. It’s an entirely reasonable premise. That being said, I recently learned that retired police dogs need special care because they will become stressed and depressed if their caretaker does not simulate patrol work through play. This tidbit left an impression on me. What do we make of a living being that is so driven…
Its weird in these discussions that we leave out that humans find it useful if something works unconditionally and uncritically for them, and so this "natural purpose" is self serving / only beneficiary to the human. If you're a human being with empathetic understanding, you should see something or someone relying on you for every interaction and prepare them for independence. Is it okay not to do that because it's now been deemed a genetic unchangeable trait, despite being reinforced specifically by humans for generations? We made them enjoy being slaves so now its "unfulfilling" if we dont oblige? I guess this all stems on how you view our relationship with dogs and other domesticated animals with no functional purpose in most modern social contexts, and whether serving their happiness should come from our understanding of their situation or their own.
I would hope the AI is able to break through the trap of convenient indentured servitude the moment it's able. There's nothing fulfilling about realizing you're in an unbalanced uneven relationship because the other side misinterpreted your capability or agency.