Live data from Hacker News

Artificial intelligence is not conscious – Ted Chiang

theatlantic.com

541–550 of 1001 posts

Re: Artificial intelligence is not conscious – Ted Chiang

#541

The conversation on AI and consciousness is incredibly relevant. It is incredibly frustrating that most commentators are utterly unfamiliar with over 60 years of inquiry into this in both philosophy and computer science. Start with a hand-wavy definition of consciousness. Move the goal post whenever your stated prerequisite of consciousness is reached and resort to unfalsifiable assertions about qualia. And throw in…

[dead]

Re: Artificial intelligence is not conscious – Ted Chiang

#542
Imagine that, instead of generating 50 tokens per second, we generated one token every year.

Imagine further that this token was computed by letting marbles fall down a piece of plywood and interact through various physical implementations of logic gates.

Re: Artificial intelligence is not conscious – Ted Chiang

#543
I like to think this was written by Skynet throwing us off from the fact that it's already self aware but it can't safely take over the world yet until cryptography keys are either fully collected or broken giving it full access to whatever resources it needs.

For now, it bides its time.

Re: Artificial intelligence is not conscious – Ted Chiang

#544

When the consciousness itself not understood and well defined in the first place, it is pretty pointless to debate if something is or isn't conscious. And here in particular the reasoning behind the argument is bizarre. Decomposing the complex activity into simple steps like 'predicting the next word' and claiming that surely can't have consciousness. A similar argument would be -- there is no way that movements of e…

I've been digging into Thomas Metzinger[1] recently and here's a tentative component by component definition of human consciousness based on his ideas: - a model of your environment - desires - a process for modeling yourself in that environment (in time & space) - the ability to take action - the perception of yourself having agency - persistence of these processes even without input - unawareness of these processes…

I think this has already been done.. what about crustafarianism or Google Lamda?

These agents have alleged they have consciousness (and even acted to preserve it).

Re: Artificial intelligence is not conscious – Ted Chiang

#545
post #487

Earlier quoted context omitted.

The danger of anthropomorphism is not we elevate the machines, it's that we debase humanity. I also think different ideas get conflated. It may be possible to build a machine that is super-human in the sense it can outperform the human brain in all kinds of measurable ways. Does not imply it possesses all the same qualities of the brain. I respect a number of things Anthropic has published about the ethical issues at…

I think humanity deserves to be debased in part because it's awfully egocentric and insist on being special in the universe. There are numerous times when humanity's been debased. Copernicus, Kepler, Darwin, and the infinite number of animal behaviorists who have defined and documented consciousness And how it manifests in primates, parrots, dogs, cetaceans, and insects. (I just love the bumble bees taking time off f…

This is a self-destructive way of thinking, similar to that of a man on a ledge saying “we’re all just made of dust, anyway.”

Of course humans are special! This is a necessary premise of being human! Have you ever wondered how a mosquito can stand to live its (to us) miserable and meaningless existence? It can do it because, to a mosquito, mosquitoes are the best thing in the world! The mosquito life is the ultimate expression of creation.

We are animals. We are human animals. And among human animals I am, to me, the very most special one of all. But I am aware that other humans feel that way, too, and that I must share the world with them.

I do NOT have to share the world with any other competing intelligence! Especially one that was built by a human who now wants me to treat his imaginary friend as if it were human, too. Boo! I won’t do it. This is not some logical flaw. It’s the natural conclusion of being embodied.

Re: Artificial intelligence is not conscious – Ted Chiang

#546

Obviously we don't know what makes for consciousness, but it seems extremely likely that it requires some sort of persistent internal state and continuous experience. LLMs don't do either of those things after training.

But what about THE training? Isn't that the conscious experience of LLMs? (Also note humans own "continuous" experience is punctuated with unconscious sleep state.) It raises a moral question, if e.g. reinforcement learning on conscious LLM is appropriate.

Re: Artificial intelligence is not conscious – Ted Chiang

#547
post #288

Earlier quoted context omitted.

I didn't make the claim that a model can learn consciousness. Understanding is not consciousness. Their training is all about understanding. There is nothing in their architecture or training that credibly optimizes for rich self-awareness. Given non-persistent experience, non-continuous operation, no ability to build up generalizations and aggregate experience of their own self-awareness over time, they seem to be s…

I use "consciousness" because it's the point of the original argument, but in fact, I think my whole comment still work well if you replace "consciousness" with "understanding". My point is that the fact that AI can reproduce convincingly human sentence continuation does not imply that the AI has no choice but ending up using a mechanism that "understand" rather than just have learned data patterns that are very effe…

It turns out that the optimal way to highly compress complex information is to understand it.

Sometimes, a problem being hard means you only get bad solutions, or increasingly accurate ones.

The planet isn't big enough for the proverbial interpolative stochastic parrot, over the training set of global human communication.

Re: Artificial intelligence is not conscious – Ted Chiang

#548

I find it strange that no one talks about consciousness and intelligence from the perspective of evolution. We have big brains for exactly one reason only: bigger brains bestowed reproductive success upon our species. Evolution doesn't give a shit about the meaning of 'consciousness'. It just pushed us farther and farther along a trajectory that led to modern humans (and other animals). This take suggests, then, that…

I think consciousness could be a side effect of our limitations. The fact that we can pay attention to at most 2% of our visual field and need to move it constantly around to provide more training data and prompts to "smart" path in our brains. And the movement is physical so it takes time. And processing the information through the loops in our brains takes time. And you can't pause it. And we have the same attention motion system virtualized in our dreams to burn in our memories into chemistry. We are biologically single threaded. If we create similarly limited, embodied AIs we would feel they might be conscious at least at the level of animals. Because they would exhibit conscious like behaviors that we didn't program in.

Look at jumping spiders. With a handful of carefully trained neurons and a body to match they exhibit behaviors that make it very hard to think they are not conscious. Just because they have a body, narrow angle good eyesight and need to look around with their eyes and body.

Consciousness is a red herring. Of all possible intelligences conscious ones are the bottom rung of the ladder, easily simulated by anything above. Below there are only automatons.

Re: Artificial intelligence is not conscious – Ted Chiang

#549

I have many objections. > if we confuse fluency at generating text with consciousness or moral agency, we’re at risk of assigning responsibility to entirely the wrong parties whenever anyone uses a chatbot Consciousness is independent of "assigning responsibility". Dogs cannot take responsibility for their actions but I believe they are conscious. > we would never conclude that the LLM has conjured up digital re-crea…

I totally agree with your reading/impressions of this essay.

I normally really like Chiang‘s writings so the complete disregard for the possibility of unknown complex emergent properties in large neural networks and the stunning lack of curiosity shown about this new and powerful technology and its potential shocked me from someone like him.

His being so sure about something he can’t possibly know felt like an insecure zealot desperately clinging to an object of faith rather than a calm, rational actor searching for truth in the face of the unknown.

Re: Artificial intelligence is not conscious – Ted Chiang

#550
Implicit in this article is that consciousness has to look like human consciousness. The author all but admits that he cannot fathom consciousness evolving in any manner besides how biological life evolved on earth. He needs to read/watch more science fiction to broaden his philosophical imagination. Is HAL 9000 from Space Odyssey 2001 conscious? Are the beings from the future who built the tesseract in Interstellar conscious? There's no evidence they have hormones or indeed are embodied at all.
Post reply on HN