Live data from Hacker News

Simple Explanation of LLMs

blog.oedemis.io

31–33 of 33 posts

Re: Simple Explanation of LLMs

#31
post #30

Earlier quoted context omitted.

> I must stress that the idea of "Science predicting facts" is a consolidated formula in Philosophy of Science. Respectfully, I'd suggest that you are misinterpreting it or using the wrong terminology. Science is not a thing, it is a process: A hypothesis is a prediction about the world, which is validated or disproven via experiment. A validated hypothesis -- like Newton's physics -- is a model for how the world wor…

> Respectfully I have titles in the discipline. I know and I am supposed to know what you wrote there well. What I was telling you is that the use of 'predict' for the nature of Science is well established; of course it is a rhetoric simplification - but language in use is. Please see (I had to return to it a few weeks ago for another discussion) the article about Imre Lakatos in the Stanford Encyclopedia of Philosop…

Sure, and I apologize if I came across as condescending or rude.

You raise interesting points.

I'd propose a wager, but I'm not sure what the terms ought to be.

In general, I think that procedural thinking is a problem that is basically already cracked, and that all (or nearly all) hard problems that the 99.5th percentile human can solve, in any given domain, will be soluble by artificial intelligences in the near enough future. Five years, I think, would be a wild over-estimate. Maybe two?

I also think that, as a general rule, "prediction = intelligence" and that the breadth, accuracy, and extensibility of one's predictive capabilities is essentially correlated with just how intelligent one is. It doesn't matter how it happens; it can be a black box. Humans, to be sure, are black boxes. I think that scientists have been trying to simulate the nematode c.elegans brain for about two decades, and as far as I know they still haven't succeeded, despite it only having 900 neurons.

Re: Simple Explanation of LLMs

#32
post #28

Earlier quoted context omitted.

Besides that I don't think that the prediction thing is a bad thing, there should be an argument that depending on the architecture there can be a self discovery of rules though compression. The compression leads to rules which could feel like understanding. People say 'ah it's just a parrot repeating statically most common words' like this alone makes it unimpressive, which it doesn't. Not when an LLM responds to yo…

> If that basic thing talks like a human, why would be a human be something different? Because properly intelligent humans actually think instead of being thinking simulators, as is apparent from the quality of the LLM outputs. > parrot ... like this alone makes it unimpressive "What could possibly go wrong".

And you have any argument at all?

After all the output of these LLMs is often significant better than what a lot of humans are capable

Re: Simple Explanation of LLMs

#33
post #28

Earlier quoted context omitted.

> If that basic thing talks like a human, why would be a human be something different? Because properly intelligent humans actually think instead of being thinking simulators, as is apparent from the quality of the LLM outputs. > parrot ... like this alone makes it unimpressive "What could possibly go wrong".

And you have any argument at all? After all the output of these LLMs is often significant better than what a lot of humans are capable

> And you have any argument at all?

To state what exactly?

> than what a lot of humans are capable

And what is that supposed to imply?

I suggest you read the exchange with member A_D_E_P_T just parallel, there are reasons to think it contains the requested replies.

Post reply on HN