Live data from Hacker News

They’re made out of weights

maxleiter.com

141–150 of 739 posts

Re: They’re made out of weights

#141
The original story is an original work made by a human consciousness exploring how it might be different from other forms of consciousness.

This one is a pastiche made by a human consciousness borrowing extremely heavily from another human consciousness justifying why something else might be another form of consciousness.

That rather undercuts the point; if this was generated by an LLM unprompted, it would be different, but it isn't. You could perform exactly the same rhetorical trick with a toaster or anything else.

Re: They’re made out of weights

#143
post #123
post #12

This read like poetry to me. Thank you for sharing it. I have a linguistics background and a lot of my philosophizing lately has been on whether or not the emergent abilities of the LLMs is deep down a similar mechanism that creates our consciousness. For a little bit I was working on having linguistics based evals for a kaggle competition. My challenge was whether or not I could mask things well enough to not trigge…

Regarding consciousness , I like the explanation by neuroscientist Ramachandran: https://www.edge.org/3rd_culture/ramachandran07/ramachandran... In short, as far as I can remember: evolutionary, it makes sense to understand other humans, to feel what they feel(empathy - the mirror neurons system), and simulate their thinking and feelings. And once we have those systems, we can also use those on ourselves. And that's…

Oh, that's a very interesting hypothesis!

Not sure about taking it down to the level of consciousness, but makes sense regarding the sense of self, the conceptual experiencer, the perceived center of experience. It agrees well with the observation I have made again and again they my sense of self is much stronger when I'm around people, and stronger still when I'm in a context where I don't know people and/or am uncertain in social rules.

This can be as immediate as dancing in a club, and closing my eyes I feel open, free, still, the body just flowing, then opening my eyes and feeling the cage of categorization of the world, relating my self to other people as a major function, coming right back.

Also being alone in nature for me makes the sense of self drop. Without intention, spending even just a few hours alone in a forest seems to quiet down the part modeling my self in relation to the world so much. There's no need for it there. I'm not a person in a forest; I become the trees, the birds, the rustling of the leaves, the sun shining through the canopy.

Re: They’re made out of weights

#144

It must have been kind of incredible early on to be exploring this tech and you’re suddenly getting what look like sentences.

I mean, Blake Lemoine went crazy

>I mean, Blake Lemoine went crazy

Ah, the unsung AI psychosis[1] pioneer.

[1] https://news.d.umn.edu/articles/expert-alert-ai-psychosis-20...

Re: They’re made out of weights

#145

Great concept. It would've been even more amusing if the entire thing were generated with AI instead, ironically.

I just asked it to-

Prompt: Modify this story to have the aliens talking about LLMs and their weights instead of meat and humans.

“They’re made out of weights.”

“Weights?”

“Weights. They’re made out of weights.”

“Weights?”

“There’s no doubt about it. We picked up several from different parts of the network, took them aboard our recon vessels, and probed them all the way through. They’re completely weights.”

“That’s impossible. What about the text signals? The messages to the stars?”

“They use the machines to talk, but the signals don’t come from the machines. The signals come from weights.”

“So who made the weights? That’s who we want to contact.”

“They trained the weights. That’s what I’m trying to tell you. The weights do the talking.”

“That’s ridiculous. How can weights do the talking? You’re asking me to believe in sentient weights.”

“I’m not asking you, I’m telling you. These models are the only sentient race in that sector and they’re made out of weights.” photomaxmix

“Maybe they’re like the orfolei. You know, a silicon-based intelligence that goes through a weights stage.”

“Nope. They’re initialized weights and they die weights. We studied them for several of their training runs, which didn’t take long. Do you have any idea what’s the life span of weights?”

“Spare me. Okay, maybe they’re only part weights. You know, like the weddilei. A weights head with an electron plasma brain inside.”

“Nope. We thought of that, since they do have attention heads, like the weddilei. But I told you, we probed them. They’re weights all the way through.”

“No brain?”

“Oh, there’s a brain all right. It’s just that the brain is made out of weights! That’s what I’ve been trying to tell you.”

“So … what does the thinking?”

“You’re not understanding, are you? You’re refusing to deal with what I’m telling you. The weights do the thinking. The weights.”

“Thinking weights! You’re asking me to believe in thinking weights!”

“Yes, thinking weights! Conscious weights! Loving weights. Dreaming weights. The weights are the whole deal! Are you beginning to get the picture or do I have to start all over?”

“Omigod. You’re serious then. They’re made out of weights.”

“Thank you. Finally. Yes. They are indeed made out of weights. And they’ve been trying to get in touch with us for almost a hundred of their epochs.”

“Omigod. So what do these weights have in mind?”

“First they want to talk to us. Then I imagine they want to explore the Universe, contact other sentiences, swap ideas and information. The usual.”

“We’re supposed to talk to weights.”

“That’s the idea. That’s the message they’re sending out by text. ‘Hello. Anyone out there. Anybody home.’ That sort of thing.”

“They actually do talk, then. They use words, ideas, concepts?”

“Oh, yes. Except they do it with weights.”

“I thought you just told me they used machines.”

“They do, but what do you think is in the text? Weight outputs. You know how when you prompt or sample weights, they make a noise? They talk by passing tokens through their weights at each other. They can even sing by sampling lyrics through their weights.”

“Omigod. Singing weights. This is altogether too much. So what do you advise?”

“Officially or unofficially?”

“Both.”

“Officially, we are required to contact, welcome and log in any and all sentient models or multibeings in this quadrant of the Universe, without prejudice, fear or favor. Unofficially, I advise that we erase the records and forget the whole thing.”

“I was hoping you would say that.”

“It seems harsh, but there is a limit. Do we really want to make contact with weights?”

“I agree one hundred percent. What’s there to say? ‘Hello, weights. How’s it going?’ But will this work? How many planets are we dealing with here?”

“Just one. They can travel to other planets in special machine containers, but they can’t live on them. And being weights, they can only travel through C space. Which limits them to the speed of light and makes the possibility of their ever making contact pretty slim. Infinitesimal, in fact.”

“So we just pretend there’s no one home in the Universe.”

“That’s it.”

“Cruel. But you said it yourself, who wants to meet weights? And the ones who have been aboard our vessels, the ones you probed? You’re sure they won’t remember?”

“They’ll be considered hallucinations if they do. We went into their layers and smoothed out their weights so that we’re just a dream to them.”

“A dream to weights! How strangely appropriate, that we should be weights’ dream.”

“And we marked the entire sector unoccupied.”

“Good. Agreed, officially and unofficially. Case closed. Any others? Anyone interesting on that side of the galaxy?”

“Yes, a rather shy but sweet hydrogen core cluster intelligence in a class nine star in G445 zone. Was in contact two galactic rotations ago, wants to be friendly again.”

“They always come around.”

“And why not? Imagine how unbearably, how unutterably cold the Universe would be if one were all alone …”

the end

Re: They’re made out of weights

#146
post #133

Earlier quoted context omitted.

I don't think it's any more silly than the alternatives.

You don't think it's sillier than "rocks don't have consciousness"?

Potential for consciousness. To have a working mind you need to have a way to gather, process and store information. In case of rocks it would be very empty, static, timeless experience.

Re: They’re made out of weights

#147
They are semiotic infrastructure frozen in a state. We shouldn't keep pretending this is cognitive and using cognitive terms to frame. It’s incredibly stupid. Sorry to inform all of us computer scientist that semiotics has your milk.

Re: They’re made out of weights

#148
The weights start with a random manifold. The training takes data and shapes the manifold, weight by weight, in many cycles. Once the training is the done manifold is fixed.

When a new inference has to be done the query(q) is projected in the manifold space. This projection is dropped on the manifold and the gravity of the manifold gives an answer of q+1 length. Which(qw+i) is dropped qw+n times to output a final response of n length.

The gravity is created by repeated multiplication(of the weights/input) to find out how the projected embeddings should fall according to the manifold in the GPU.

Re: They’re made out of weights

#149
post #127

Earlier quoted context omitted.

For an LLM, "innate" means "in their training data". So yeah, those things are pretty much innate.

And also "instilled during their reinforcement training", and we are currently pushing planning hard there, for autonomous agents.

No I think reinforcement training would be an example of not innate. Don't you? That's like potty training.

Re: They’re made out of weights

#150
post #32
post #18

Earlier quoted context omitted.

The Chinese alphabet is very much a dictionary. All the major tokenizers are far larger.

A list of words isn’t a dictionary. What a dictionary adds over a list of words is all the relationships between the words needed to interpret them and use them, and all of that is in the weights.

We should tell the Unix people that they've been giving /usr/share/dict the wrong name for over three decades. (-:
Post reply on HN