Live data from Hacker News

They’re made out of weights

maxleiter.com

441–450 of 739 posts

Re: They’re made out of weights

#441
post #431
post #161

After reading Being and Time from Martin Heidegger, What Computers can't still do by Hubert Dreyfus, and some authors in cognitive linguistics (Langacker and Lakoff mainly), I strongly tend to disagree with any theory about emergent consciousness in modern or future AI systems, any theory proposing a similarity between AI systems and the human brain/mind, or any theory about the computational mind. What all these the…

> I highly recommend people in the AI research space should read philosophy and modern linguistics. On the contrary, I highly recommend people in Philosophy of mind and linguistics should start reading AI research papers because their theories and ideas are highly outdated, even ancient. Your books are from 1927 and 1972 respectively and Turing's article is from 1950s. And they are relatively new with respect to othe…

Yikes dude. You may need to expand your horizons a bit.

Re: They’re made out of weights

#442
post #371

This would be a masterpiece if it was half as long, the second half is not as convincing or compelling.

Indeed, the leap takes place in the second half.

> Cruel. But you said it yourself, who wants to apologize to weights?

How did we leap to this? There's nothing to apologize to. They're weights.

Re: They’re made out of weights

#444
post #376

Earlier quoted context omitted.

Quantum field effects? You don't need these, IMHO, if you look at how highly parallel things seem to work in brains. Marvin Minsky's theory of a "Society of Mind" describes a (highly) distributed model of the mind. Which BTW, always reminds me of the first Shrek movie, where the donkey jumps up and down, shouting "Take me! Take me!" to Shrek. That's similar to what I observe when I'm undecided but two instances of "s…

Mostly I have a hard time accepting that a Turing machine can experience "consciousness"/awareness. Therefore I also have a hard time with simulatable chemical processes; it feels like there is some missing link there. All just feelings/vibes unfortunately.

I can sympathise with you, but how could a "quantum" effect" doesn't make this easier?

Maybe "Turing machine" is too abstract or simplistic as a concept? Both for real computers and brains?

I can see that a computer is on some level just a lot of sand (silica and metal) but put together in a really complex way, it "suddenly" can add and compare numbers … if we observe the complexity levels from sand to computer and try to see the analogy when comparing cells / neurons to a structure of billions of them somehow interconnected on both a physical and chemical level, evolved during millions of years, I have no problem to accept that brains are still too complex to explain for us.

Re: They’re made out of weights

#445

Earlier quoted context omitted.

> These theories are flawed in the sense that they cannot account for subjective experience and agency, amongst other things. On the contrary, it's precisely this assumption, that there is a "subjective experience" that requires explanation beyond the material, that is axiomatically assumed without evidence. It falls apart quickly, any "subjective experience" is completely tied to neurons, knock out the neurons and t…

I find the claim subjective experience may be illusory absolutely baffling. I can only speak for myself with certainty, but I am entirely sure I have subjective experience. All the other propositions I believe could be false but I don't see how I can be wrong about experiencing something. I could be a brain in a vat (or weights on a GPU) and be specifically programmed to only come to false beliefs and still I can be…

My current understand that "subjective experience" is a post effect of memory forming in the process. "I experience X" ≈ "I remember that I just recently received [external stimulus / interpreted my current state as] X".

And I am as well baffled why people make such a big deal out of "subjective experience" and "consciousness".

I was joking that maybe I miss this properties, but now starting to really wonder if it might be the case. What if these phenomenons are present in humans to various extent? Check aphantasia. Only in XIX we discovered, that ability to visualize mental images is not universal, available to different people to various degree and some people completely miss it. My ability to visualize is weak. What if "consciousness" and "subjective experience" are similar?

And I am slightly worried when I am writing this that it might turn to be truth and in ~20 years I will be treated as "inferior human" without complete set of human rights.

Re: They’re made out of weights

#446

Earlier quoted context omitted.

> What's the relevance? It directly parallels your argument. > Can you be straight with me? You know the salient difference between asserting the consciousness of a toaster and the consciousness of an AI, right? It isn't a mystery to you why we would find one line of inquiry interesting and the other not so much? There are two aspects here. 1. That people find the question interesting 2. That it has any bearing on re…

> It directly parallels your argument. Much like Russel argued that the burden of proof of God's existence is on theists, the burden to establish this parallel is on you as the person forwarding the argument. I don't see any relevant connection. Russel isn't arguing that a teapot is as real as God in the same way it's disputed here that a toaster is as conscious as an LLM. > So far you have said that the argument is…

> Much like Russel argued that the burden of proof of God's existence is on theists, the burden to establish this parallel is on you as the person forwarding the argument.

I pointed out the parallel in both statements. I can't do more than that.

> Russel isn't arguing that a teapot is as real as God in the same way it's disputed here that a toaster is as conscious as an LLM.

The teapot isn't real and the toaster consciousness is not real. What am I missing?

> AI is a real phenomenon that we can study and measure.

Robot cows are real as well.

> There is no experiment that anyone has devised can determine whether or not they are conscious, so that is the reality - uncertainty. That doesn't mean they're conscious. It means that the belief they are not conscious is assumption.

Yeah. You can't prove it for any entity. I agree.

> You might say the same of a toaster, but these hypothesis are not equally strong. The toaster doesn't exhibit any behaviors to suggest that it's conscious. Consciousness isn't a hypothesis with any explanatory power for the observed behaviors of a toaster. It's not a hypothesis that's on the table. That's why the analogy doesn't work.

The bull swears that the robot cow is a real cow. But we know better.

> To put a fine point on it, it appears on it's face that AIs could be conscious.

It doesn't to me. Not any facelength.

> They can put on a very convincing performance of being a person. A sufficiently convincing performance is indistinguishable from the real thing.

Objective reality has never cared (am I anthropomorphizing now?) what is indistinguishable for people.

> So at face value, the burden of proof is on them not being conscious.

Which party is the burden of proof on? This is confusing since you are saying that the burden of proof is on a position (on them not being conscious).

Is the burden of proof on people who argue that they are n o t conscious? That's peculiar.

I have never heard about any principle in philosophy or in science that says that, given enough Looks Like A Duck points, it is a duck. Based on subjective experience, even.

We obviously can't demand a falsifiable theory here. But we have to do better than arguing from incredulity.

> Reductionist arguments that present the mechanics of how they work and leap to their not being conscious don't work, because there is no law saying a statistical model can't be conscious. That's an assumption, not knowledge.

They don't have to rise to the level of disproving something for which they have no burden to disprove.

Re: They’re made out of weights

#447

Earlier quoted context omitted.

This proves too much. As it would imply parrots have sapiencee.

Why do you think that parrots do not have sapience? How would one even measure such a thing?

Because by definition, sapience is something only humans have. Ergo, parrots are not sapient.

More meta, all of the threads on this page are just people playing games with definitions. Eg, “qualia is something I have as a human but machines don’t have it. Therefore, LLMs do not have qualia.”

Re: They’re made out of weights

#448

The original story is an original work made by a human consciousness exploring how it might be different from other forms of consciousness. This one is a pastiche made by a human consciousness borrowing extremely heavily from another human consciousness justifying why something else might be another form of consciousness. That rather undercuts the point; if this was generated by an LLM unprompted, it would be differe…

You can't do the same with a toaster. Physically you could write that story. But it would fall flat because the toaster is not a compelling subject in a discussion of consciousness. You don't have to believe that LLMs or AI agents are conscious to acknowledge that the argument for their consciousness is far more compelling than any other technological artifact.

Only because you haven't met toasty yet.

https://youtu.be/LRq_SAuQDec?si=LFJMXZ2yGu4fxXzL

Re: They’re made out of weights

#449

Earlier quoted context omitted.

You actually read Being and Time? What the heck do you get out of it? Heidegger just seems to play word games with German words without actually saying anything. "Time is the ripening of temporality." tf do phrases like that mean??

Not OP, but I have read Being and Time on and off over the years, and every time, I am blown away how precise Heidegger describes things and the being of things. Granted, I am German, so I can directly read the source without needing a translator. That might change things. Regardless, I think Heidegger gave one of the fullest metaphysic-free accounts of the human experience and what Being is. And he starts from scrat…

I keep hearing "it's better in German" which really reinforces my point that he's just playing word games with etymologies without saying anything.

Re: They’re made out of weights

#450

I don't like to say one way or the other on things. Especially LLM's. However, if ive learned anything about LLMs and real life problems, is to break it down to the foundation like already mention with weights being compared to neurons and map the parallels.

The neural network in LLMs are not really that similar to brains. Here are a couple of the biggest differences:

1. Brains are plastic, making connections, breaking connections and changing "weights" on the fly. LLM have static weights. The best they have is writing to MEMORY.md or data getting used in the training run for the next model.

2. LLMs neural networks do not have loops. The best they have is that their output is available as future input, but that is not the same.

Post reply on HN