The article misses three critical points: 1. Conflates consciousness with "thinking" - LLMs may process information effectively without being conscious, but the article treats these as the same phenomenon 2. Ignores the cerebellum cases - We have documented cases of humans leading normal lives with little to no brain beyond a cerebellum, which contradicts simplistic "brain = deep learning" equivalences 3. Most damnin…
> Conflates consciousness with "thinking" I don't see it. Got a quote that demonstrates this?
The Case That A.I. Is Thinking
261–270 of 1001 posts
Re: The Case That A.I. Is Thinking
#262Earlier quoted context omitted.
> or possessed of subjective experience in any measurable way We don't know how to measure subjective experience in other people, even, other than via self-reporting, so this is a meaningless statement. Of course we don't know whether they are, and of course we can't measure it. I also don't know for sure whether or not you are "possessed of subjective experience" as I can't measure it. > What they are not is conscio…
> Unless we can find indications that humans can exceed the Turing computable - something we as of yet have no indication is even theoretically possible - there is no rational reason to think it can't. But doesn't this rely on the same thing you suggest we don't have, which is a working and definable definition of consciousness? I think a lot of the 'well, we can't define consciousness so we don't know what it is so…
No, it's like saying we have no indication that humans have psychic powers and can levitate objects with their minds. The commenter is saying no human has ever demonstrated the ability to figure things out that aren't Turing computable and we have no reason to suspect this ability is even theoretically possible (for anything, human or otherwise).
Re: The Case That A.I. Is Thinking
#263Earlier quoted context omitted.
> Conflates consciousness with "thinking" I don't see it. Got a quote that demonstrates this?
I'm not really onboard with the whole LLM's-are-conscious thing. OTOH, I am totally onboard with the whole "homo sapiens exterminated every other intelligent hominid and maybe — just maybe — we're not very nice to other intelligences". So, I try not to let my inborn genetic predisposition to exterminate other intelligence pseudo-hominids color my opinions too much.
Re: The Case That A.I. Is Thinking
#264Re: The Case That A.I. Is Thinking
#265The debate around whether or not transformer-architecture-based AIs can "think" or not is so exhausting and I'm over it. What's much more interesting is the question of "If what LLMs do today isn't actual thinking, what is something that only an actually thinking entity can do that LLMs can't?". Otherwise we go in endless circles about language and meaning of words instead of discussing practical, demonstrable capabi…
This is pretty much exactly what https://arcprize.org/arc-agi is working on.
Re: The Case That A.I. Is Thinking
#266Earlier quoted context omitted.
You're claiming that the thinking is just a fictional story intended to look like it. But this is false, because the thinking exhibits cause and effect and a lot of good reasoning. If you change the inputs, the thinking continues to be pretty good with the new inputs. It's not a story, it's not fictional, it's producing genuinely reasonable conclusions around data it hasn't seen before. So how is it therefore not act…
The problem is that the overwhelming majority of input it has in-fact seen somewhere in the corpus it was trained on. Certainly not one for one but easily an 98% match. This is the whole point of what the other person is trying to comment on i think. The reality is most of language is regurgitating 99% to communicate an internal state in a very compressed form. That 1% tho maybe is the magic that makes us human. We c…
Creating complex Excel spreadsheet structures comes to mind, I just did that earlier today - and with plain GPT-5, not even -Thinking. Sure, maybe the Excel formulas themselves are a "98% match" to training data, but it takes real cognition (or whatever you want to call it) to figure out which ones to use and how to use them appropriately for a given situation, and how to structure the spreadsheet etc.
Re: The Case That A.I. Is Thinking
#267I think the challenge with many of these conversations is that they assume consciousness emerges through purely mechanical means. The “brain as a computer” metaphor has been useful in limited contexts—especially for modeling memory or signal processing; but, I don’t think it helps us move forward when talking about consciousness itself. Penrose and Hameroff’s quantum consciousness hypothesis, while still very specula…
The tendency to attribute consciousness to the quantum is one I find very grating. What makes the human brain any less mechanical if quantum mechanics dictate the firing of neurons rather than electrodynamics? Why does the wave nature of subatomic systems mean that an artificial tongue would suddenly be able to subjectively experience taste? It always reads to me as very wooy, and any amount of drilling leads to even…
Human mind is weird, and poorly understood, and isn't deterministic - or, at least, most humans like to think that it isn't.
No wonder the two are intuitively associated. The two kinds of magic fairy dust must have the same magic at their foundation!
Re: The Case That A.I. Is Thinking
#268Earlier quoted context omitted.
You're claiming that the thinking is just a fictional story intended to look like it. But this is false, because the thinking exhibits cause and effect and a lot of good reasoning. If you change the inputs, the thinking continues to be pretty good with the new inputs. It's not a story, it's not fictional, it's producing genuinely reasonable conclusions around data it hasn't seen before. So how is it therefore not act…
The problem is that the overwhelming majority of input it has in-fact seen somewhere in the corpus it was trained on. Certainly not one for one but easily an 98% match. This is the whole point of what the other person is trying to comment on i think. The reality is most of language is regurgitating 99% to communicate an internal state in a very compressed form. That 1% tho maybe is the magic that makes us human. We c…
But it thinks just great on stuff it wasn't trained on.
I give it code I wrote that is not in its training data, using new concepts I've come up with in an academic paper I'm writing, and ask it to extend the code in a certain way in accordance with those concepts, and it does a great job.
This isn't regurgitation. Even if a lot of LLM usage is, the whole point is that it does fantastically with stuff that is brand new too. It's genuinely creating new, valuable stuff it's never seen before. Assembling it in ways that require thinking.
Re: The Case That A.I. Is Thinking
#269Earlier quoted context omitted.
What makes you think consciousness is tightly coupled to intelligence?
It's hardly an unreasonable supposition: the one definitely conscious entities we know of are also the apex intelligence of the planet. To put it another way: lots of things are conscious, but humans are definitely the most conscious beings on Earth.
Re: The Case That A.I. Is Thinking
#270Earlier quoted context omitted.
How is it a false dichotomy? If you want consciousness to NOT be simulateable, then you need some essential component to our minds that can't be simulated (call it soul or whatever) and for that thing to interface with our physical bodies (obviously). We have zero evidence for either. > does not mean that the essential thing gives rise to consciousness is only approximate But we have 8 billion different instances tha…
> plenty of them have all kinds of defects, Defects that have not rendered them unconscious, as long as they still are alive. You seem not to see the circularity of your argument. I gave you an example to show that robustness against adverse conditions is NOT the same as internal resiliency. Those defect, as far as we know, are not affecting the origin of consciousness itself. Which is my point. > How is it a false d…
This makes no sense as written - by definition, there is no concept of "at the same time" for events that are spacelike separated like this. Quantum entanglement allows you to know something about the statistical outcomes of experiments that are carried over a long distance away from you, but that's about it (there's a simpler version, where you can know some facts for certain, but that one actually looks just like classical correlation, so it's not that interesting on its own).
I do get the point that we don't know what we don't know, so that a radical new form of physics, as alien to current physics as quantum entanglement is to classical physics, could exist. But this is an anti-scientific position to take. There's nothing about consciousness that breaks any known law of physics today, so the only logical position is to suppose that consciousness is explainable by current physics. We can't go around positing unknown new physics behind every phenomenon we haven't entirely characterized and understood yet.