Live data from Hacker News

They’re made out of weights

maxleiter.com

251–260 of 739 posts

Re: They’re made out of weights

#251
post #227

Earlier quoted context omitted.

Is matter code? There is some sort of computation happening in space over time.

By Fermat's principle, a ray of light has to know where it will ultimately end up before it can choose the direction to begin moving in. So either something is computing it or some exploration is happening at quantum level and we just see the final result.

> a ray of light has to know where it will ultimately end up before it can choose the direction to begin moving in

I'm no physicists, so I guess I'll ask it: Why?

Also related, why do some ray of light then "see" a black hole yet decide to head into them anyways, if they saw it before they went in that direction? Seems like a dumb move :)

Re: They’re made out of weights

#252
post #179

Earlier quoted context omitted.

> beyond a certain number of transformations, people are willing to treat it as some sort of miracle, and too tired to figure out why it came up with the answer it came up with It’s less about being too tired and more about being realistic about the limits of understanding. Consider mass and energy flows in planet-scale systems: At some point we call these “weather” and change the tools with which we study them, but…

When we attempt to recreate those complex, planetary atmospheric phenomena in a box, we're doing so in order to measure and study them. Making random turbulence in a box until it resembles the outside world, and calling it weather and extrapolating some predictive meaning from the result, is the total antithesis of what you're describing about why we come up with simplified models for impossibly complex systems. The…

> The purpose of [mathematical] models that are built thoughtfully is to explain why complex systems are the way they are, with data and algorithms, however imperfectly.

Nope. The main purpose of the whole endeavor is usually to predict the behavior of a complex system, because that's actually what we care about. If we can predict it, we can adapt to it, and eventually use it to our advantage.

Explaining why a complex system is the way it is, is merely nice-to-have. Models are opinions. All of them are wrong, but some are useful, and we rank them by how useful they are. The models and explanations are important because, beyond their elegance and convenience, it's also the case that more accurate models give you better predictions across larger domains, meaning we get better at getting something useful out of the complex system.

People get fixated on modern theoretical science, with bottom-up mathematical explanations traced through seas of empirical data, with whole magical rituals of peer review and double-blind studies and statistical significance around them. But they forget that the core of empirical science is literally throwing shit at a wall to see what sticks. That is the guiding principle, everything else is just making the process more efficient.

Understanding complex natural systems (or even engineered ones that got too complex) always starts with tests - tests on the real thing, then on approximate models that we poke and prod and bash into shape until they start acting similarly to the real thing. It's through the poking and bashing, and how they affect our proxy model, that we glean insights into nature of the simulated phenomena, and eventually formulate general theories - but more importantly, the models give us useful predictions from the start, before we have any theories explaining why.

Re: They’re made out of weights

#253
post #139
post #123

Earlier quoted context omitted.

Regarding consciousness , I like the explanation by neuroscientist Ramachandran: https://www.edge.org/3rd_culture/ramachandran07/ramachandran... In short, as far as I can remember: evolutionary, it makes sense to understand other humans, to feel what they feel(empathy - the mirror neurons system), and simulate their thinking and feelings. And once we have those systems, we can also use those on ourselves. And that's…

This way of thinking can only explain externally-visible parts of consciousness. It does nothing to address internal experience of being conscious and qualia. I don't think the internal experience has any bearing on physical reality (P-zombies would act the same externally) which makes this something outside of the realm of currently understood physics.

There are some evolutionary theories why did qualia("phenomenal awareness") evolved. I don't know much about those, so i can't write about that.

Re: They’re made out of weights

#254
According to an LLM:

> The precise answer, if you wanted a very honest one-liner: > > I am a large set of learned weights organized in a Transformer architecture that performs repeated matrix multiplications to predict the next token—resulting in emergent language understanding and generation.

Re: They’re made out of weights

#255
post #227

Earlier quoted context omitted.

Is matter code? There is some sort of computation happening in space over time.

By Fermat's principle, a ray of light has to know where it will ultimately end up before it can choose the direction to begin moving in. So either something is computing it or some exploration is happening at quantum level and we just see the final result.

Fermat's principle is an outcome of constructive interference of waves. It works both for classical and quantummechanical descriptions. E.g. check https://phys.libretexts.org/Bookshelves/University_Physics/U...

Re: They’re made out of weights

#256

Can someone ELI5 why does it costs so much in terms of compute to produce weights from data?

I think it's simply because we haven't found a better algorithm than backpropagation. We're stuck relying on massive datasets, running the numbers over and over, and working backward from errors to figure out how to fine-tune trillions of 'knobs.' Then, we have to do this at least once for every single token across the entire internet. Any tiny bit of computation, when multiplied by a base that massive, inevitably skyrockets into astronomical numbers.

Re: They’re made out of weights

#257
post #18
post #13

Earlier quoted context omitted.

A tokenizer is not a dictionary any more than an alphabet is a dictionary.

The Chinese alphabet is very much a dictionary. All the major tokenizers are far larger.

It's beside the point and so I only note it out of interest, but the Chinese writing system doesn't use an alphabet (or a syllabary like Japanese kana), it's logography.

Re: They’re made out of weights

#258

Earlier quoted context omitted.

By Fermat's principle, a ray of light has to know where it will ultimately end up before it can choose the direction to begin moving in. So either something is computing it or some exploration is happening at quantum level and we just see the final result.

Fermat's principle is an outcome of constructive interference of waves. It works both for classical and quantummechanical descriptions. E.g. check https://phys.libretexts.org/Bookshelves/University_Physics/U...

True, so the interference is the "computation"(heavy emphasis on quotes) which gives rise to the principle.

Re: They’re made out of weights

#259
post #161

After reading Being and Time from Martin Heidegger, What Computers can't still do by Hubert Dreyfus, and some authors in cognitive linguistics (Langacker and Lakoff mainly), I strongly tend to disagree with any theory about emergent consciousness in modern or future AI systems, any theory proposing a similarity between AI systems and the human brain/mind, or any theory about the computational mind. What all these the…

> These theories are flawed in the sense that they cannot account for subjective experience and agency, amongst other things.

On the contrary, it's precisely this assumption, that there is a "subjective experience" that requires explanation beyond the material, that is axiomatically assumed without evidence. It falls apart quickly, any "subjective experience" is completely tied to neurons, knock out the neurons and the subjective experience disappears, or stimulate the neurons to cause the experience.

Re: They’re made out of weights

#260

The original story is an original work made by a human consciousness exploring how it might be different from other forms of consciousness. This one is a pastiche made by a human consciousness borrowing extremely heavily from another human consciousness justifying why something else might be another form of consciousness. That rather undercuts the point; if this was generated by an LLM unprompted, it would be differe…

I feel the original story contained in it the whole point of this one, and then some.

This did not add anything, just rephrased it so rather than humans viewed through the pov of aliens it's LLMs viewed through the pov of humans. Well, we are the humans, so surely we do not need to learn about this point of view?

Post reply on HN