Live data from Hacker News

Consciousness is not computation

joe-antognini.github.io

711–720 of 767 posts

Re: Consciousness is not computation

#711

Earlier quoted context omitted.

> there's an explicit description of how one state transitions to the next. That's part of the definition of the Turing machine! A Turing machine does indeed describe which states the machine transitions between (by its definition). So, it might say that if it reads a "1" and is in state "A", transition to state "B". However, crucially, a Turing machine does not specify the physical mechanism by which this state tran…

I think you’re skipping over one or two crucial steps there; let me try to put my finger on it. The key feature of a universal Turing machine is that it can perform any computation, if fed the right program. In your thought experiment where you’re mapping the internal state of an iron bar, to claim it’s a valid mapping to a Turing machine, it must be possible to feed in any program, after the mapping has been defined…

> it must be possible to feed in any program, after the mapping has been defined.

This is absolutely correct and gets to the heart of it. We define a mapping and we can imagine even setting some of the spins of the atoms in the bar to input a particular "program." Then we sit back and watch the spins randomly flip and see if they correspond to what a universal Turing machine would do.

The reason that a hot iron bar in practice is not a computer is that there is no way we can easily find the correct mapping before we observe the bar. The process of finding this mapping will take more work than the computation itself. (I think this is what you mean in saying "the computation is really happening in the mapping itself.") So for our purposes it's useless for performing any computations. Nevertheless, some mapping from the bar's states to a Turing machine executing the program we've given it exists.

This is why this is different for the case of consciousness. Because consciousness exists independent of whether or not we're aware of it, it doesn't matter whether or not we can find this mapping beforehand. It just matters that such a mapping exists.

It would be different if I made the claim that the iron bar is sorting a list. I might say, "there exists a mapping of the states of the iron bar to a Turing machine running quicksort. Therefore the iron bar is sorting a list." The appropriate response would be "So what? If I consider all random permutations of the list, obviously one of them will be sorted --- but how does that help me find it? It takes me the same amount of work to find this mapping as it does to sort the list."

But if we are to say that consciousness is fundamentally a computational phenomenon, it doesn't matter if you find the mapping or not --- it exists independent of you.

Re: Consciousness is not computation

#712
post #701

Earlier quoted context omitted.

>It is true that to actually perform either a physical instantiation is necessary... That's all I'm saying. When you say 'computation is not a physical process', I think that's an ambiguous statement. The actual computation of something must be physically performed for it to occur, otherwise no computation takes place. >The guy who claimed that LaMDA was conscious wasn't basing his claim on something specific about t…

If you say that there is a property X of computation that occurs independently of how the computation is actually carried out, whether it's by a current generation CPU, hydraulics, lego blocks, someone writing values and following instructions on index cards or some other method that no one has even thought of yet then that property is an abstract property of computation. That's all the word "abstract" means in this…

>If you say that there is a property X of computation that occurs independently of how the computation is actually carried out... That's all the word "abstract" means in this context.

Ok, that makes sense, sure.

>...because hopefully we agree that mathematics only studies abstract properties...

I can't agree, performing a calculation isn't an abstract concept, it's a physical process. It does map to abstract concepts though.

>Beyond that I argue that computation itself is entirely abstract and though I don't seem to be able to get you to admit that, I think most people, certainly most computer scientists would admit it readily.

That is not the case. The fact that computation is fundamentally a physical process is a core principle of several branches of physics and computer science:

https://en.wikipedia.org/wiki/Computation https://royalsocietypublishing.org/doi/10.1098/rspa.2014.018...

Computers aren't abstract, they're real objects doing things in the real world. If the thing they are physically doing is not computation, what is it?

>So what we're left with is a claim that an abstract process can produce something that is not abstract and such claims are just not plausible. That would be exactly like a computer simulation of the weather producing actual water.

Abstractions cannot affect the real world, sure, so if computation is purely abstract how come your computer can display my message on your physical screen right now? How is that happening, if not by computation?

You're really tangling yourself up in knots with this view of abstraction. You can map what happens in a computer against abstract concepts and abstract objects yes. You can also map operations in several different physical systems against the same abstract objects. That's what it means when we say computation is implementation independent. But it still needs to be implemented to actually happen.

Previously you said this:

>Computation is not a physical process any more than addition is a physical process. It is true that to actually perform either a physical instantiation is necessary...

So it's not a physical process, but you can instantiate it. And it's purely abstract so can't affect the physical world. Yet here we are using computers.

I'm lost, frankly.

Re: Consciousness is not computation

#713
post #712

Earlier quoted context omitted.

If you say that there is a property X of computation that occurs independently of how the computation is actually carried out, whether it's by a current generation CPU, hydraulics, lego blocks, someone writing values and following instructions on index cards or some other method that no one has even thought of yet then that property is an abstract property of computation. That's all the word "abstract" means in this…

>If you say that there is a property X of computation that occurs independently of how the computation is actually carried out... That's all the word "abstract" means in this context. Ok, that makes sense, sure. >...because hopefully we agree that mathematics only studies abstract properties... I can't agree, performing a calculation isn't an abstract concept, it's a physical process. It does map to abstract concepts…

I don't think there's much point in continuing this thread since we obviously have very different ways of conceptualizing reality.

I will say one more thing however:

I never said that abstractions cannot affect the physical world, I said that they cannot produce non-abstract things. A computation can affect the physical world by modulating the flow of electrons (which already existed, they were not created by the computation) to an output device, such as a screen that will display something you can see. But everything described in that last sentence isn't part of the abstract computation itself, it's a side-effect when the computation is run on a particular type of hardware. If instead you ran the same program using a human computer, as Alan Turing suggested in his well known paper on the halting problem, which largely created the field of computer science, then the result would not be displayed on a screen but instead perhaps written on a piece of paper. Nonetheless it's the same computation that was run in both cases. That's why computation is intrinsically abstract by nature.

Re: Consciousness is not computation

#714
post #668
post #566

Earlier quoted context omitted.

I actually don't think the observable universe is big enough, and that's been demonstrated mathematically by better people than I, but the universe as a whole including non-observable parts might be big enough. I don't see how this is not the Bolzmann's Brain proposition. What's the difference? >Consciousness can have a materialist explanation yet also be substrate dependent to an extent. I suppose so, maybe there's…

If the observable universe is too small, what about the observable universe sampled at multiple points in time? Or just an iron bar that's repeatedly sampled along a time interval, with the desired encoding changing between each sample such that the object doesn't need to undergo much change it state in order to map to distinct things. Each sample increases the number of physical states that we can create a mapping f…

>The Boltzmann Brain says that our conscious experience at the current moment is a chance quantum event.

I just meant that the proposition that an iron bar might be viewed as containing a consciousness, is similar to the idea in the BB proposition that consciousnesses might arise spontaneously in random matter in space. Well they might, but that doesn't prove or refute anything about consciousness.

The bit about Boltzmann's Brains possibly outnumbering real evolved brains is a separate philosophical question I didn't mean to address, and I apologise for the confusion.

Re: Consciousness is not computation

#715
post #656

Earlier quoted context omitted.

Not exactly. I am saying that consciousness is fundamental; that matter, physics, our brains, etc emerge from consciousness. Physics is the OS, consciousness is the transistors/electricity, and we are conscious agents (to borrow a term from Donald Hoffman) using the OS. So, instead of the physicalist paradigm of Physics -> Chemistry -> Biology -> Psychology -> Consciousness it is the idealist paradigm of Consciousnes…

That doesn't change the question though. We don't know how many layers are beneath the known laws of physics. Who knows, one of them could be consciousness. Maybe it's turtles all the way down. They question remains. Can you provide a direct answer? If we measured all the particles in the brain, would they be operating in a way not compatible with the currently known laws of physics?

>If we measured all the particles in the brain, would they be operating in a way not compatible with the currently known laws of physics?

Their operation would be perfectly compatible with the known laws of physics. But their operation is _not_ thinking itself, it's what thinking looks like when observed across a dissociative boundary. If I am sad, and you look at my face and see tears, you would never think that the tears were my sadness itself; they are a representation, an image, of the sadness. Tears are what sadness looks like from across that boundary. I experience sadness from a first-person perspective, you see my tears from a second-person perspective, across a dissociative boundary. So, you can measure electrical activity in your brain when you are thinking thoughts, but that activity is not your thoughts, in the same way that flames are the image of fire but they are not fire itself. Neuronal activity is the image of thought, it is what your thoughts look like from across a dissociative boundary.

Re: Consciousness is not computation

#716
post #678

Earlier quoted context omitted.

Sure, if you define subjective experience as "all sensory information." I'm not denying that we have sensory input; I'm denying that its abstractions are any more than illusory constructs of the mind. The computer in my example knew things and had thoughts, despite not having access to actual qualia. Do you disagree that the computer in my hypothetical example would have the intuitions it does about its own senses? G…

Part of the problem is that people tend to use words very loosely. In particular they often use words that anthropomorphize computers and when they use such words its hard to tell whether they intend for them to be taken literally or are just using them as a figure of speech. Your example starts of by telling us that the computer is known not to have qualia, which I understand to mean that it does not have subjective…

An intelligence doesn't need to experience qualia in order to have an internal thought process. Picture a thought process the way it might look if we could inspect our own minds: A prolonged monologue of ideas being continually appended to with new information and conjectures. "It's hot in here. This is an interesting article, but I disagree because . What should I do tomorrow? Maybe I should get a haircut," etc. Obviously such a log wouldn't be written entirely in English, but it would have a language of its own, after a fashion.

When I talk about "an intelligence," I mean a thing with an internal thought process which can reflect upon its own thought process in a non-trivial way. This excludes large language models like LaMDA which don't really have semantic thoughts, but it would certainly be possible for a true computer intelligence along these lines to exist which nonetheless didn't experience "actual qualia" (assuming qualia are real, existing things).

A stream of consciousness thought process has input---it can sense temperature, it can observe its own hair, it can read articles---and for the purposes of our model, we can suppose that this input is appended to its internal log similarly to how new thoughts are. This sensory input is abstract: A thought process may sense heat---i.e. sensory information about the external temperature may be entered into the thought process---but the thought process can't go on to make any real observations about that sensation. A thought process can't interpret sensory input as anything beyond simply "a distinct input of this or that type with a relative magnitude of whatever," because that input is abstract and irreducible. Further thoughts in the thought process will describe these sensory inputs as vivid, unique, and ineffable when they reflect upon them, but those properties only exist as a product of the relationship between the thought process and its input. The ineffable qualities of these senses as described by their thought process is not a real thing, but only an interpretation.

So when I hear the argument, "I can reflect on the way my senses feed into my thoughts, and by their apparent ineffable and transcendental nature, I can say they're self-evidently real things that exist outside of my own beliefs about them," I'm pretty skeptical. A computer intelligence with an internal thought process like I described above would reach those same conclusions simply by virtue of the relationship between its sensory input and its thoughts. We're not unbiased observers; our perspective as an intelligence breaks down when we try to reason about the nature of the abstract and atomic inputs which our thought process is based upon. Because of the way senses feed into thoughts, an intelligence can't help but find them ineffable and transcendental; therefore, when I find my own sensory information to be ineffable and transcendental, I can't take that at face value as anything more than an illusion of perspective.

> Because I have them. I am not a black box to myself, I get to look inside and when I do I find that there are conscious experiences there. That's just not something I can, even in principle, be mistaken about.

A computerized thought process can look at its own thoughts too, but there's no reason to suppose that it (and you) can't draw mistaken conclusions about them. For instance, the mistaken conclusion that the distinctness of one input or another must be a real existing quality and not just a logical axiom essential to the functioning of that thought process.

Re: Consciousness is not computation

#717
post #333
post #318

Earlier quoted context omitted.

I think the burden is on the proponents. Otherwise anyone could make any assertion - for example, that action potentials cause consciousness, or that influx of ions cause consciousness, or that vibrations cause consciousness, or that only humans are conscious. Like "computation is consciousness" those are just all just, perhaps, correlates of consciousness, not mechanisms for producing it.

The Occam's razor favors the simpler explanation though.

Why is "emerging from computation" simple? As an explanation, it seems vastly more complex. I mean, the laws of physics don't even contain terms for defining or valuing computation. Even my examples (which were meant to be bad arbitrary explanations) at least have the benefit of being describable as physical quantities. So at least one side of the explanation is already grounded in things that physics recognizes.

Re: Consciousness is not computation

#718
post #319
post #312

Earlier quoted context omitted.

But the argument shows it's absurd to think the room is conscious. What if the person in the room takes a coffee break or goes on vacation? What connects the next computational step they do to the previous one and the next... which then somehow gives rise to a fragment of qualia. That seems like an impossibly complex and unlikely scientific theory.

> What if the person in the room takes a coffee break or goes on vacation? Regular meat-and-bone people lose consciousness all the time, and regain it later. No big deal. > What connects the next computational step they do to the previous one and the next... Whatever index card system or similar the operating procedure in the room prescribes for keeping track of state? > which then somehow gives rise to a fragment of…

> Regular meat-and-bone people lose consciousness all the time, and regain it later. No big deal.

So what? There are lots of REAL physical processes that are disrupted in a human being when they lose consciousness.

The point of the Chinese Room is to show that information processing alone is insufficient for consciousness. For example is information processing happening when the person pauses for a minute - or not? For a second, for a millisecond? What about when the pen comes off the paper? What about when he's sharpening his pencil? How exactly does the consciousness=information processing idea work for these situations? It's a nonsense idea that doesn't hold up to careful inspection.

And it's exactly akin to saying we get nuclear power by simulating a nuclear power plant in a computer.

On the other hand, if we believe that consciousness is like an ordinary physical property of the universe, either emergent or fundamental, then it should be related to other physical properties, just as electromagnetism is to mass and energy.

Re: Consciousness is not computation

#719
post #715

Earlier quoted context omitted.

That doesn't change the question though. We don't know how many layers are beneath the known laws of physics. Who knows, one of them could be consciousness. Maybe it's turtles all the way down. They question remains. Can you provide a direct answer? If we measured all the particles in the brain, would they be operating in a way not compatible with the currently known laws of physics?

>If we measured all the particles in the brain, would they be operating in a way not compatible with the currently known laws of physics? Their operation would be perfectly compatible with the known laws of physics. But their operation is _not_ thinking itself, it's what thinking looks like when observed across a dissociative boundary. If I am sad, and you look at my face and see tears, you would never think that the…

Okay, so if I use the laws of physics to simulate a human brain, it will behave exactly like a human brain in the real world. Will it also be conscious and experience sadness?

Re: Consciousness is not computation

#720
post #319
post #312

Earlier quoted context omitted.

But the argument shows it's absurd to think the room is conscious. What if the person in the room takes a coffee break or goes on vacation? What connects the next computational step they do to the previous one and the next... which then somehow gives rise to a fragment of qualia. That seems like an impossibly complex and unlikely scientific theory.

> What if the person in the room takes a coffee break or goes on vacation? Regular meat-and-bone people lose consciousness all the time, and regain it later. No big deal. > What connects the next computational step they do to the previous one and the next... Whatever index card system or similar the operating procedure in the room prescribes for keeping track of state? > which then somehow gives rise to a fragment of…

> Whatever index card system or similar the operating procedure in the room prescribes for keeping track of state?

You're missing the point. A bit is just some electrons. It could be a scribble in a notebook. But consciousness integrates several pieces of information into a coherent experience. The bits in an index card system could as well be some scratchings of graphite in a notebook. How would consciousness arise from graphite in a notebook?

> We don't have any 'scientific theory' of qualia. We don't even know if they exist,

I differ on this. The only thing I know for certain the universe contains is qualia. You, the idea there is a "me", atoms, bits, axons and electric potentials are merely ideas, which "I" apprehend as qualia.

> or how they would manifest in the physical world.

Correct, that is the question. But the Chinese room thought experiment shows it's not merely by information processing. I mean, atoms in a room are processing information - they are computing the next state of all of the atoms in the room. Are they conscious? How about a subset of those atoms? Are those conscious in a different way?

The point is that the consciousness-is-computation idea is just too weak to even be a physical theory.

Post reply on HN