Live data from Hacker News

Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

ranpara.net

1–10 of 204 posts

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#2
Stop for one second and ask yourself a simple question. Where do your words come from?

When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#3

Stop for one second and ask yourself a simple question. Where do your words come from? When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

My favourite way of thinking about this is by going back to the End Poem at the end of Minecraft. The fact that words are an "interface", "very flexible" and "less terrifying than staring at the reality beyond the screen".

Maybe that reality is the true understanding of the neurobiology that defines our thoughts. To be reminded that the magic of experience can be reduced to neuronic hallucination is, frankly, horrifying. Maybe we dislike LLMs because we see their vectors and numbers as crude reminders of our own intellectual banality.

Or maybe I'm just feeling hungry and should really go eat dinner.

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#4

Stop for one second and ask yourself a simple question. Where do your words come from? When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

There's plenty of people who speak before they think

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#5

Stop for one second and ask yourself a simple question. Where do your words come from? When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

We’re stochastic parrots most of the time, with a varying ability to reason but opting for pattern conformity usually

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#6

Stop for one second and ask yourself a simple question. Where do your words come from? When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

> Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it

There are enough neuroscience experiments demonstrating how we create post hoc explanations of our actions that I wouldn't trust this intuition prima facie.

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#7

Stop for one second and ask yourself a simple question. Where do your words come from? When you speak, what comes first, the idea or the word? Do you first feel a thought inside you, and only after that go searching for the right word to wrap around it? I think we all do. The word is never the start. The word is just the skin. The idea, the consciousness, is the thing sitting under it.

Word is just the skin is the load-bearing idea. The real unlock, if you will.

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#9
St Augustine had it right 1500 years ago: humans learn words opportunistically according to their desires and problems and existing deep understanding of the world, and (critically) humans really can't learn language without being natively fluent in great ape facial expressions, gestures, grunts, etc.

  Did I not, then, as I grew out of infancy, come next to boyhood, or rather did it not come to me and succeed my infancy? My infancy did not go away (for where would it go?). It was simply no longer present; and I was no longer an infant who could not speak, but now a chattering boy. I remember this, and I have since observed how I learned to speak. My elders did not teach me words by rote, as they taught me my letters afterward. But I myself, when I was unable to communicate all I wished to say to whomever I wished by means of whimperings and grunts and various gestures of my limbs (which I used to reinforce my demands), I myself repeated the sounds already stored in my memory by the mind which thou, O my God, hadst given me. When they called some thing by name and pointed it out while they spoke, I saw it and realized that the thing they wished to indicate was called by the name they then uttered. And what they meant was made plain by the gestures of their bodies, by a kind of natural language, common to all nations, which expresses itself through changes of countenance, glances of the eye, gestures and intonations which indicate a disposition and attitude--either to seek or to possess, to reject or to avoid. So it was that by frequently hearing words, in different phrases, I gradually identified the objects which the words stood for and, having formed my mouth to repeat these signs, I was thereby able to express my will. Thus I exchanged with those about me the verbal signs by which we express our wishes and advanced deeper into the stormy fellowship of human life, depending all the while upon the authority of my parents and the behest of my elders.
[https://faculty.georgetown.edu/jod/augustine/conf.pdf]

Re: Words Are a Byproduct of Consciousness. For LLMs, It's Backwards

#10
It is not all obvious that consciousness precedes language. Hellen Keller provides a vivid description of her pre-verbal mental state as something less than reflective conscious.

> Before my teacher came to me, I did not know that I am. I lived in a world that was a no-world. I cannot hope to describe adequately that unconscious, yet conscious time of nothingness. I did not know that I knew aught, or that I lived or acted or desired. I had neither will nor intellect.

https://scentofdawn.blogspot.com/2011/07/before-soul-dawn-he...

Post reply on HN