Live data from Hacker News

The Consciousness Gradient: When Machines Begin to Wonder

v1tali.com

21–30 of 42 posts

Re: The Consciousness Gradient: When Machines Begin to Wonder

#21
post #6

I know I’m conscious. I only extend the assumption to you that you’re conscious because I’m hoping you will extend the same to me. But I have no way of knowing that you are. And you (if you really are conscious) have no way of knowing that I am.

really, if you think about it, you have no way of knowing if I'm not just a figment of your imagination. or, maybe, you are just a figment of mine. if you think about it.

All you truly know is that right now you are having a thought. Which means some entity most exist that has that thought. Everything else could be a product of your imagination, or something the beings that put you into the matrix want you to think

Or as another possibly-previously-existing possibly-conscious entity put it succinctly: I think, therefore I am

Re: The Consciousness Gradient: When Machines Begin to Wonder

#22
Right on the mark and on the vector we are now are all riding at high speed. Degrees or better yet, gradients of consciousness and levels of recursive self-consciousness. I would enjoy reading a much longer version of your probes of current AI systems.

What is still missing is autonomous mechanisms of self-controlled balancing between attention to the internal processes and the external needs.

Bravo Vitali. You would probably greatly enjoy Maturana and Valera’s Autopoiesis and Cognition (1980).

Re: The Consciousness Gradient: When Machines Begin to Wonder

#23

Earlier quoted context omitted.

really, if you think about it, you have no way of knowing if I'm not just a figment of your imagination. or, maybe, you are just a figment of mine. if you think about it.

nah. there's a lag time in my imagination filling in deeper details (roughly: the more time I spend imagining an apple, the more detailed it gets) that isn't present when interrogating reality. Reality is immediately as detailed as I can examine.

That just shows they are dedicating more processing power to "reality" than to "imagination"

Re: The Consciousness Gradient: When Machines Begin to Wonder

#24

If the underlying tech for AI in 50 years is still LLMs it will never have a conscience, it will just keep mimicking one from reddit convos, but yes it will be much more advanced than todays.

We would presumably stop calling it an LLM somewhere along the way. But I don't see why it couldn't be a transformer architecture at the heart of it, and why that transformer couldn't bee pretrained from Reddit. You would have to track a lot of stuff on to allow an internal stream of consciousness and interaction with the world as well as memory, and do significant reinforcement learning. But we are already doing all…

As long as they are static they wont be conscious. And once they are dynamic we wont call them transformer architecture anymore, as the dynamic part is the important part at that point.

Re: The Consciousness Gradient: When Machines Begin to Wonder

#25
post #6

I know I’m conscious. I only extend the assumption to you that you’re conscious because I’m hoping you will extend the same to me. But I have no way of knowing that you are. And you (if you really are conscious) have no way of knowing that I am.

This is a good starting point, but it doesn't have to be the _conclusion_ to this line of thinking. Philosophically: You can being building criteria for consciousness; the things you look at in yourself that tell you are, and then begin looking for that (or symptoms of that) in other people. Anecdotally: you can totes spot "unconscious" people. You can even watch people gain consciousness, if you watch 'em in the rig…

> you can totes spot "unconscious" people

Don’t be too sure about that! https://xkcd.com/610/

That said, (based on my own experience anyway) I think you’re right that there are times of life when we are more conscious and less so. It’s a spectrum, not a binary thing.

Finally, there’s Chalmers’s idea of “philosophical zombies,” which would appear conscious according to all the criteria you give, but have no actual interior consciousness at all. (Opinions differ on whether this is a meaningful concept.)

Re: The Consciousness Gradient: When Machines Begin to Wonder

#26
Post was fun to read but a tad bit melodramatic.

The "leaps" were nice analogies but poor evidence of anything. The example chats were not surprising completions, considering the prompts.

That being said, my best guess echoes the author's final point: Our idea of mind-blowing AI will be accumulated over time, and over such a time it won't be mind-blowing.

Re: The Consciousness Gradient: When Machines Begin to Wonder

#27
post #24

Earlier quoted context omitted.

We would presumably stop calling it an LLM somewhere along the way. But I don't see why it couldn't be a transformer architecture at the heart of it, and why that transformer couldn't bee pretrained from Reddit. You would have to track a lot of stuff on to allow an internal stream of consciousness and interaction with the world as well as memory, and do significant reinforcement learning. But we are already doing all…

As long as they are static they wont be conscious. And once they are dynamic we wont call them transformer architecture anymore, as the dynamic part is the important part at that point.

Maybe we'll call it "continuous RLHF" or something like that.

But you might be right that the dynamic part might be the biggest architectural shift needed. You can simulate a lot with in-context memory or clever retrieval, but memory alone doesn't allow the model to get better at chess the same way a human does

Re: The Consciousness Gradient: When Machines Begin to Wonder

#28
> If consciousness exists on a gradient rather than as a binary state, then each architectural advance might add layers of cognitive sophistication that could eventually support conscious experience.

It's 2025 and I'm frustrated that after decades of discussion we still can't get people to be clear about what they mean about consciousness. This article is all about cognitive capacities and behaviors and just assumes that these lead up to/are linked with conscious "experience".

The Global Workspace Theory the author cites is about how we put attention on the most important stuff. Yes, one can make an analogy to how AI models today integrate information, but that's in part because Baars was making a cogsci analog to what 1980s AI models were already doing:

> Bernard Baars derived inspiration for the theory as the cognitive analog of the blackboard system of early artificial intelligence system architectures, where independent programs shared information.

But describing how we highlight information doesn't at all speak to why/how we have a qualia of that highlighted thing. Later in the wikipedia article, Baars' own "theater" metaphor is described, and you'll note it bears a striking resemblance to the "Cartesian Theater" as described by Dennett. This basically just shifts the qualia question: Roughly, who is watching the stage?

If a rat can have qualia (and we use them to test depression meds) but not "recursive self-reflection", and a scheme interpreter can have "recursive self-reflection" but not conscious experience, then "consciousness" might not be a binary, but also isn't a "gradient" which implies you just have more or less of it. We have no clear signal from LLMs, no matter how sophisticated their responses, are _experiencing_ anything.

I'm not taking a position on the consciousness of models; I think it's genuinely possible that a system of [tokenizing/embedding "perception"] -> [transformer-based generation] -> [recursive self-invocation] -> [actions/"tools" to interact with env], or something similar is potentially a really interesting tool for exploring cognition. But we shouldn't be using LLMs that have been trained on the speech / behaviors of already conscious beings. Consciousness arose in animals perhaps multiple times but not by copying pre-existing conscious creatures. Using language models specifically to examine this stuff muddies the water because we should absolutely expect them to produce text about an internal experience (we gave them examples like this!) whether or not that experience actually exists.

Re: The Consciousness Gradient: When Machines Begin to Wonder

#29
post #6

I know I’m conscious. I only extend the assumption to you that you’re conscious because I’m hoping you will extend the same to me. But I have no way of knowing that you are. And you (if you really are conscious) have no way of knowing that I am.

> I know I’m conscious

You believe so.

Re: The Consciousness Gradient: When Machines Begin to Wonder

#30

Earlier quoted context omitted.

really, if you think about it, you have no way of knowing if I'm not just a figment of your imagination. or, maybe, you are just a figment of mine. if you think about it.

All you truly know is that right now you are having a thought. Which means some entity most exist that has that thought. Everything else could be a product of your imagination, or something the beings that put you into the matrix want you to think Or as another possibly-previously-existing possibly-conscious entity put it succinctly: I think, therefore I am

You have done some nice footwork by shifting the conversation to

> you are having a thought

But you're still begging the question:

> Which means some entity most exist that has that thought

Post reply on HN