Live data from Hacker News

They’re made out of weights

maxleiter.com

701–710 of 739 posts

Re: They’re made out of weights

#701

Earlier quoted context omitted.

I feel like these are separate things... neural activity being necessary but not sufficient for consciousness does not mean reductionism is wrong, it just means the fundamental building block is not a neuron. It might not even be possible to fully understand the physical mechanisms that underlie consciousness, but that doesn't mean there has to be something more than physical mechanisms.

Yes. Even to this reductionist, “neural activity” is insufficient to describe to consciousness in the same way that “it’s physics” is insufficient to describe how a car works. I could put a bunch of metal and rubber and gasoline in a pile and light it on fire — all the necessary ingredients for a car — but it wouldn’t create a working automobile. The arrangement of the objects and processes matters. In the same way,…

Reductionism is a theoretical framework. It is neither right nor wrong, Sometimes a theory based on reductionism is wrong, but reductionism it self is never wrong.

Reductionism usually includes interactions of the lower parts (unless you are an atomist; in which case go back to ancient Greece), I never denied this. However even with the interactions, reductionism is still a lacking framework to describe consciousness. If it wasn’t so lacking it would be more popular among the people who actually study the mind.

Re: They’re made out of weights

#702
post #695
post #534

Earlier quoted context omitted.

> On the contrary, I highly recommend people in Philosophy of mind and linguistics should start reading AI research papers because their theories and ideas are highly outdated, even ancient. Your books are from 1927 and 1972 respectively and Turing's article is from 1950s. And they are relatively new with respect to other works in Philosophy. People in philosophy and cognitive linguistics do read AI research. Don't g…

> Maybe you can clarify why they are outdated. The First Edition (1995) of the classic textbook Artificial Intelligence: A Modern Approach by Russell and Norvig talks about the criticisms of Dreyfus quite extensively. In the second edition (2003) they conclude: "In sum, many of the issues Dreyfus has focused on-background commonsense knowledge, the qualification problem, uncertainty, learning, compiled forms of decis…

I have that book at home and I'll check as soon as I get back from a trip.

When Dreyfus' book appeared in 1972, it received really harsh criticism from the then AI community. Dreyfus actually comments on that criticism in the revised 1992 edition.

I just don't see how Dreyfus critique of AI has been dealt with in modern AI: the critique is aimed at fundamental issues, not at the technical issues.

It is true that the critique written by Dreyfus is based on GOFAI algorithms from the 60s, but it is also true that if you read the book today, you'll find lots of similar situations and a similar way of thinking about the possibilities of AI, as well as the same underlying assumptions.

And as a side note, outdated means that it does not apply anymore, or that is not relevant anymore. Which is different from 'establishing a dialogue' with the text/author, in a way that 'seems' not to be relevant anymore. If you say that Dreyfus' book is outdated just because the 4th edition of Norvig's text only mentions it in a footnote, you are assuming that Norvig and Russell's opinion are definitive. They might be not.

I have authors like Norvig, Russel, LeCun, Minsky and other in the field in high regard. But they are normally not trained in either modern linguistics nor philosophy. Let alone the rest, large amount of researchers in the field. AI research is a complex field, and maybe (in this we could follow Foucault) not even a science. Doing research in an area of study does not turn it into science.

It is precisely philosophy, and even more contemporary philosophy, the discipline that focuses on how we build knowledge, and how we experience the world. Two really important, almost fundamental, topics that directly contribute to how AI is developed as a field of knowledge.

Re: They’re made out of weights

#703
post #524

Earlier quoted context omitted.

None of the works I mentioned solved or try to solve the mind/body problem or the issue of consciousness. They are a frame of reference for not stepping into the common fallacies that the AI research field is based on.

What's exactly the fallacy? How do the works help avoid stepping into that "fallacy" if they don't try to solve the issue of consciousness.

The issue of consciousness appears when you think of the world in a mechanistic way: since all there is are laws of physics and materiality, then how could we explain our though processes and our perceptual experience? If the world itself (in a general, existential way) is only made of laws of physics and matter, the consciousness needs to be an emergent characteristic of physical systems, and needs to follow the laws of physics. Now at this stage, you are already in trouble and you need to explain what consciousness is and how it manifestates. And that's the moment where things like the computational theory of mind appears.

But you need to step back in order to detect the fallacy, one of which is: the brain/mind processes information like a computer, then we could build better computers that can think. This fallacy is assumed in the question 'can a machine think?'. There's another fallacy, which the author call the first step fallacy, which is common nowadays: we solved the language problem, then machines will be able to think in the near future.

So it is not about solving the consciousness problem, it is about not claiming things based on assumptions that can be easily challenged.

Re: They’re made out of weights

#704
post #686

Earlier quoted context omitted.

We know how LLMs learn at the fundamental level. What we do not know is the actual dynamic process of encoding embeddings and their distributions. Your analogies about the PC and web browser are not correctly formulated, because in the case of the PC you talk about 'external components' (you should be talking about cpu arch, structure, digital components, interfaces, etc); in the case of the web browser, you should b…

Your references that "back that claim", which are in "books you mentioned", which you "mentioned" who knows where. Yeah, no. I'm not walking that chain. If you want to, do it, but for now, I'm filing it as "has no evidence and knows it". By now, there's plenty of works, up to and including direct neural interfaces. Utah arrays, Michigan arrays. Stab the brain, dump the spike trains, decode. You crack the manifold ope…

> Your references that "back that claim", which are in "books you mentioned", which you "mentioned" who knows where. Yeah, no. I'm not walking that chain. If you want to, do it, but for now, I'm filing it as "has no evidence and knows it".

You are free not to believe me and dismiss the whole point. I do have evidence and I know it, no need to prove that (to begin with, the references are there. Read them if you want to expand your knowledge).

> By now, there's plenty of works, up to and including direct neural interfaces. Utah arrays, Michigan arrays. Stab the brain, dump the spike trains, decode. You crack the manifold open by correlating to known stimuli using ML, and generalize from there to unknown stimuli. There is no need to "know the exact configuration", and few bother - you put your hardware into the part of the brain you want (top level map is consistent enough brain to brain), gather a set of reference points, and use them to anchor the rest of the decoding process.

I am familiar with those works. Seeing the stimuli/activation correlation does not imply causal representation of the stimuli. It implies the causal activation of neural structures, at most.

> What follows is: if you can represent "thinking" as a computational process, you can implement it with a Turing machine, and thus, an LLM can be made to think. That proves LLMs can think. But not that the existing ones do or don't! Because that's the entire thing about upper bounds!

Alas! assumption spotted. IF you can represent "thinking" as a computational process, then you could implement a thinking machine. You need to prove first that thinking _is_ a computational process, _then_ you could go and try to implement such machine, and because you proved that thinking is a computational process, you are certain that theoretically such a machine can be built. But until you prove your assumption right, you are just trying blindfolded. The harm in the actual field/society regarding AI is that _we don't even know if thinking can be modeled as a computational process_. And no, this does not have anything to do with science. (By the way, I would not regard AI research as science since it is strictly studying an engineered artifact, but that's another story).

Re: They’re made out of weights

#705
post #688
post #681

Earlier quoted context omitted.

> So why we call it subjective experience then? Probably it is irrelevant, and the reasons are purely historic... or maybe not. How about the idea of computers experiencing things, just not "subjectively" but rather "digitally"? Or choose any other adjective you like. You are arguing against assumptions, but why you just accept the idea of experience with the assumption that human way to experience things is the only…

Let me start with: > if you read the sources on AI research through its own history, you will see how the AI research space is full of such biases and assumptions. You are repeating it in different forms all the time, so it seems really important to you. I should state, that I don't believe that AI research has some special insights into human nature or into what agency is. I'm sure that they have some biases and ass…

I'm not trying to convince anyone. I am just baffled that a large part of the tech/software and AI research community do not question their own assumptions, when those assumptions are being actively questioned in other fields (namely, philosophy and linguistics).

Reaching AGI or human-level intelligence might be possible, but not on the basis of dismissing what other fields already said something about. That is arrogant, and does not help. Even more, this has already happened in the 60s/70s. And I say 'might be possible' precisely because I pay attention to what other fields have to say.

Re: They’re made out of weights

#706

Earlier quoted context omitted.

It’s not a capitalism problem, it’s an ecosystem. Wherever living things compete for finite resources and opportunities, certain properties emerge from the system. And make no mistake we live in a crowded world full of fierce competition. Among these properties are optimum behaviours such as hoarding the maximum you can defend (rather than the minimum you comfortably need) and using your power to forestall the growth…

The US American system is more capitalistic than the german one and the scissor between poor and rich is higher. Thats definitly an indication that this plays a role in it. And we do not have a problem of resources today, we have so much food, that its sometimes just spoils and no one cares and sometimes it even spoils in huge warehouses due to neglect or because a person decided not to sell it under a certain price.…

> The US American system is more capitalistic than the german one and the scissor between poor and rich is higher.

And yet the US is a dominant player and Germany is not.

> And we do not have a problem of resources today, we have so much food

I never said there needs to be scarcity for an ecosystem to emerge. These properties emerge wherever living things compete for finite resources. Imagine a pond where you introduce a few small catfish. At first, food is plentiful. Yet the fish will grow and reproduce until it is scare. It's the same with resources. Individuals/companies/societies will grow to consume the maximum they can sustain, because this is the optimum behaviour in an ecosystem.

The point is that organisms which avoid these behaviours tend to lose, in every sense of the word, to organisms that do. The behaviours are emergent from the constraints of the system.

> that its sometimes just spoils and no one cares

Transportation costs are a major driver of food shortage. It's not at all free to get large quantities of food from where they are produced to where they are consumed. People are generally not willing to transport food (or do much of anything else) at a loss.

Re: They’re made out of weights

#707
post #323

Earlier quoted context omitted.

While you write very dismissive and pseudo philosophical, enough people do not believe. I'm a complex biological thing. Existence is what i have to experience through.

>> While you write very dismissive and pseudo philosophical Even with the "pseudo" in front, I'm very sorry any of my writing sounds philosophical; I didn't intend that sort of confusion :-). The "dismissive" is not exactly intended either; instead, I was aiming for "bitter". >> enough people do not believe Here we believe different things. First, enough people, even today, do believe. Second, the body of culture we…

This looks promising, especially the no-account-required part. Does it handle SPAs or heavy client-side rendering well, or is it more geared toward traditional server-rendered sites?

Re: They’re made out of weights

#708
post #704

Earlier quoted context omitted.

Your references that "back that claim", which are in "books you mentioned", which you "mentioned" who knows where. Yeah, no. I'm not walking that chain. If you want to, do it, but for now, I'm filing it as "has no evidence and knows it". By now, there's plenty of works, up to and including direct neural interfaces. Utah arrays, Michigan arrays. Stab the brain, dump the spike trains, decode. You crack the manifold ope…

> Your references that "back that claim", which are in "books you mentioned", which you "mentioned" who knows where. Yeah, no. I'm not walking that chain. If you want to, do it, but for now, I'm filing it as "has no evidence and knows it". You are free not to believe me and dismiss the whole point. I do have evidence and I know it, no need to prove that (to begin with, the references are there. Read them if you want…

Knowing what exact algorithm "thinking" is isn't a requirement. Automata class is enough to say "a Turing machine can implement it".

There are exactly two possibilities: thinking can be expressed as computation, or thinking requires hypercomputation.

I did acknowledge both, explicitly.

Which one?

I'm betting hard against the second one, by the way. Because it requires hypercomputational magic fairy dust to:

1) exist - physical Church-Turing thesis has to be proven wrong empirically

2) be so involved in the functioning of human brain that it cannot be substituted for anything else

Wishful thinking, in my eyes.

But that's the name of the game, isn't it? Anything but admitting that your mind is a glorified math construct implemented in wet meat.

Re: They’re made out of weights

#709

The original story is an original work made by a human consciousness exploring how it might be different from other forms of consciousness. This one is a pastiche made by a human consciousness borrowing extremely heavily from another human consciousness justifying why something else might be another form of consciousness. That rather undercuts the point; if this was generated by an LLM unprompted, it would be differe…

I think that the reaction here alone disproves this somewhat, because imo it's exposing how anthropocentric most people still are, despite all evidence that we are in fact just "meat all the way down". Despite all the evidence that we are in fact just biological machines, people still persist the theory of our own uniqueness from other creatures, which we ourselves often treat as biological machines. This adaptation…

We are just animals, more capable in reasoning than many others. LLMs aren't; their subjective "experience" restarts every session, they degrade into incoherent slush with larger context windows, and their reasoning is real but extremely weak, only compensated by the a civilizational corpus of information compressed within. I concede we scaled them enough to discuss them as tools that can produce useful outputs, but claim this echo of humanity is itself conscious by any non-trivial definition is either a product of psychosis or some long-standing hatred for life.

Re: They’re made out of weights

#710
post #689
post #231

Earlier quoted context omitted.

> a compelling story about a sentient toaster "Howdy-doodly-doo! Anybody like any toast?" https://youtu.be/LRq_SAuQDec?si=YbQfnZbrCe01Bicy

your link has a si= tracking parameter

Apologies, didn't notice when I got the link from YT's "Share" button. Won't make that mistake again.

Comment is now to old to edit: for convenience, here's the link without the parameter -- https://youtu.be/LRq_SAuQDec

Post reply on HN