Live data from Hacker News

Telling GPT-4 you're scared or under pressure improves performance

aimodels.substack.com

161–170 of 255 posts

Re: Telling GPT-4 you're scared or under pressure improves performance

#161

Earlier quoted context omitted.

Sure it does. It perfectly deliniates it. LLMs are not: sensitive to causal structure, dynamically adapting to environmental changes, growing, developing sensory-motor capacities, they are not with us in our environment, they are not: expressing desires, preferences, intentions, beliefs, motivations, etc. And so on. To say, "they just predict the next word" is literally to say that all apparent functions of an LLM ar…

What if humans’ responses are merely probabilistically consistent with a history of sensory experiences? Would this change the significance of human emotions vs apparent emergent emotional responses from LLMs?

emotions regulate motivation, desire, action, behaviour etc.

to be angry is for your sensory-motor system to be primed for aggression; it's for your cognitive systems to be narrowed and focused on analysing high-threat parts of your environment; it is for your memory-formulation to be modulated towards threat recollection etc.

Sure, if an LLM's prompt "be angry" causes it to adopt a threat stance to its environment, to regulate it's theory-of-mind to engage with possible hostile entities, and so on --- then yes, when LLMs are there, I shall concede the point

However, how terrible it would be to start with an analysis of emotions in terms of the capacities of LLMs -- right?

Since if you did that you'd basically be hobbling your own ability to give an accurate account of emotions (etc.). And no doubt, far worse, end up thinking of yourself as a far narrower, less complex, less interesting, dumber thing than you really are.

Indeed, I wonder if we might consider there being something kinda intellectually offensive in this supposition. Here's my silly trinket, now, everything is just like that! End all science, we're done boys -- it's just P(Y|X)

Re: Telling GPT-4 you're scared or under pressure improves performance

#162

Earlier quoted context omitted.

The scientific method is inherently statistical, we take a finite amount of observations and construct a model that best represents those observations. So yes, sorry, I should have said 100%. With Plato's cave, the scientists do not put literally every possible object in front of the light, they sample the shadow representation and, again, construct a model around those samples. Also, you're describing statistics in…

Well if you think scientific models are associative statistical models there is some information missing in your view, I'd say. Since, well, they arent. The model F=GMm/r^2, for example, has a causal and ontological semantics: F is a force, M a mass etc. these are pieces of reality. And this formula (though actual a little suspicious in many ways, GR fixes this) nevertheless says there is a force between masses that…

> The model F=GMm/r^2, for example, has a causal and ontological semantics: F is a force, M a mass etc. these are pieces of reality. And this formula (though actual a little suspicious in many ways, GR fixes this) nevertheless says there is a force between masses that has certain properties etc.

And this model is based on the observations of Newton himself and those that came before him. There is nothing magic about observing the attraction between objects and deriving a model from that. Why are they magically "pieces of reality"? How do you know that? What differentiates mass from "funny-mass" that I just thought up and actually repels other "funny-mass"? Maybe the fact that we can test the effects described by that first model and therefore verify it as the most likely candidate?

> But he didnt derive the model from this data: there are an infinite number of (causal) models consistent with the data (statistical models).

He did derive it either from that data or his own experiences. It's true that you can construct infinite models to explain an observation, which is why the scientific method includes an Occam's razor-esque tenet to select the simplest possible model. Complex models risk contradictions with new observations, which is why you choose the one with the least assumptions. With that rule, the model to select becomes quite clear.

> There's nothing in the data to tell Newton he was right. Indeed, vast amounts of it told him it was wrong: such a law does not describe the known solar system at his time, very far away from it.

No, most of it told him he was right, unless you want to claim Newton was an idiot that stumbled onto the right model by accident. With "most" I obviously mean most reasonable data, people telling him he's wrong is obviously excluded from this list, if his evidence contradicted those claims.

> Nevertheless 'modelling shadows' isnt science; and his job was science. So one has to compare actual explanatory models, and his was the best.

And we compare those models by...?

> What you're describing above is hypothesis testing which occurs long after theory building. Broader theories create causal models, causal models create sets of predictions, we call some subset a hypothesis and by hypothesis testing we can select, in an often psuedoscientific way, between causal models.

You yourself just correctly made the point that we can construct endless models, well, we can create endless theories as well. And all of these theories are exactly worthless unless we test them. There is nothing "pseudo-scientific" about testing, it is literally the core of the scientific method. By your reasoning, are some crackpots coming up with the newest flat earth theory pure and unsullied by the lower demands of verification, and therefore way more scientific?

> identifiable formal statistical methods entered in the early 20th C.

Formal is the important word here, statistics has been used in an informal manner from the inception of life. Formal mathematics, as in mathematics on a formal axiomatic framework, has also only been introduced in the 19th century. So what? Science owes everything to informal statistics, as does engineering and art. Rules of thumb used by engineers and creation of art that satisfies our aesthetic preferences requires sampling and approximation.

> That latter system, in most cases, fails. It provides a wholly illusory sense that data can decide matters; and applies in cases requiring extreme non-physical assumptions

It literally doesn't and no, it doesn't need those assumptions either. The reason why normalcy is usually assumed is that it often can be assumed without significant deterioration in predictive power. That doesn't mean it needs to be assumed, in fact, it often isn't.

You constantly reference theory building, but how do you think those theories get created exactly? Through mathematical reasoning? How do you know mathematics is valid? Through logical deduction? How do you know logical deduction is valid? Through knowledge? How do you know knowledge... and so on.

Fact is, we only use these tools because they have proven their validity through being tested over and over and over again. And if you look at modern pseudoscience, it always seems to coincide with a proclivity for theory building, with very little hypothesis testing involved.

Re: Telling GPT-4 you're scared or under pressure improves performance

#163

Earlier quoted context omitted.

Well if you think scientific models are associative statistical models there is some information missing in your view, I'd say. Since, well, they arent. The model F=GMm/r^2, for example, has a causal and ontological semantics: F is a force, M a mass etc. these are pieces of reality. And this formula (though actual a little suspicious in many ways, GR fixes this) nevertheless says there is a force between masses that…

> The model F=GMm/r^2, for example, has a causal and ontological semantics: F is a force, M a mass etc. these are pieces of reality. And this formula (though actual a little suspicious in many ways, GR fixes this) nevertheless says there is a force between masses that has certain properties etc. And this model is based on the observations of Newton himself and those that came before him. There is nothing magic about…

Theories are built by engaging in the world using imagination, tool-making, and the like.

We first suppose that the universe is something like a glass sphere -- because we've created that. And if it is, then we derive some consequences -- if those line up, we proceed with that view until a better one comes along.

Eventually after the glass sphere view is understood, we either derive contradictions with observation; or we end up unable to derive novel consequences. Here observation is essentially singular, and indeed, the rarer reason we reject a theory. We mostly reject scientific theories because of their explanatory limits, not disagreement with observation. (Rarely can we observe enough for observation even to matter.)

In the case of the system of spheres, we built spinning devices on that basis and this motion -- along with the hydraulics and kinematic devices of the time -- was part of the development of an independent notion of force.

With some imagination, you can start to peel away material from our creations and see certain abstract causal patterns (and the like) and you then get to, eg., the universal law of gravity.

Absent this process we do not have any explanatory ideas, we cannot explain observations -- hence it takes thousands of years to get anywhere.

Applying 'statistics' to do the data to arrive at statistical models is pseudoscience; it doesnt give you any account of anything.

'Statistics' doesnt own 'testing', nor does 'science' own experiment -- theologians had their experiments (prayer, say) and scientists collected data without statistical methods.

What I am talking about is the 20th C. discipline of statistics, as a novel apparent 'core' to science -- this is ahistorical, and largely only true of pseudoscientific disciplines.

As Ernest Rutherford said, “if you need statistics to do science, then it's not science.”

It is in Rutherfod's sense of stats and of science that I speak.

Not some bizarre historical back-projection by which when Aristotle analysed cases of sea creatures, "Really", he was engaged in stats.

By this light i can just claim "Testing" is as owned by science. And so of course science requires testing -- it was the *scientific method* as developed by bacon and others that created the very conditions for "statistical methods" to derive from these

Re: Telling GPT-4 you're scared or under pressure improves performance

#164

Earlier quoted context omitted.

So I was with a financial researcher recently, and he wanted to use ChatGPT to summarise some reference financial data -- and it did so, actually correctly. Being sceptical, as every person ought in these matters, I changed the finical data and performed the same analysis (both in a new tab, and within the same convo). The results were the same! How strange? Well, in being reference financial data ChatGPT was reporti…

>Since it's incapable of actually summarising financial data It's not, though. It is in fact able to summarize financial data, just as it's able to write code and diagnose a medical condition. It makes mistakes, yes, even grave ones, much more so than experts in those fields would.

[deleted]

Re: Telling GPT-4 you're scared or under pressure improves performance

#165

Earlier quoted context omitted.

Cameras don't have eyeballs, Microphones don't have hair cells, Speakers don't have vocal cords, processors don't don't do arithmetic with neurons, yet we all agree that they are capable of emulating the meaningful aspects of these functions. All of your claims are either incorrect (not adapting, expressing desires, beliefs, preferences, ...) or fail to eliminate irrelevant differences. If we're to have any sensible…

> an implementation detail Yip, so I deny this premise. I take it to be the heart of the matter. > we might as well throw away 80% of our current scientific understanding Yip, i'd be down for that. Though maybe i'd say, 30-40%. Science in the strongest sense has no theory-building need for statistics. Those areas of science which have only statistical models, and not causal-ontological ones aren't science -- and i'd…

>How does associative statical modelling do? It takes averages of past shadows, and calls the cause of the shadow that average: this is pseudoscience. Quite correct! Throw it all away.

It does not work this way at all. In any sense.

For one thing, it does not try to draw shadows. This would not be possible of so. https://www.pnas.org/doi/full/10.1073/pnas.2016239118

Transformers or predictors are not trying to draw shadows. They are trying to build walls.

For another, it does not "take the average" of anything.

Re: Telling GPT-4 you're scared or under pressure improves performance

#166

Earlier quoted context omitted.

You can make it invent a new language: https://maximumeffort.substack.com/p/i-taught-chatgpt-to-inv... I am sure you will continue to argue that this is still in line with everything-thats-ever-written prediction but my opinion is that at that point, it's a meaningless distinction. The human brain is also just a machine.

So I was with a financial researcher recently, and he wanted to use ChatGPT to summarise some reference financial data -- and it did so, actually correctly. Being sceptical, as every person ought in these matters, I changed the finical data and performed the same analysis (both in a new tab, and within the same convo). The results were the same! How strange? Well, in being reference financial data ChatGPT was reporti…

>Since it's incapable of actually summarising financial data. It's only capable of selecting combinations of pieces of its training set.

Third completely off misconception from you today.

This is not at all what it is doing. "Supercharged Interpolation" is false and makes no sense. It's not a lookup table either. It doesn't memorize enough of what it needs to to make your assertion possible.

https://arxiv.org/abs/2110.09485

Re: Telling GPT-4 you're scared or under pressure improves performance

#167
post #94

Earlier quoted context omitted.

"A neuron just transmits signals. Any cognitive property arises as a consequence of the interplay of those electrical and chemical signals." Do we now understand consciousness? The statement appears fundamentally limited in its implied insight.

What if consciousness is an emergent illusion? “You” are merely a passenger, observing your physical self’s actions and assuming ownership of them. What if consciousness is merely an effect, not a cause?

>“You” are merely a passenger, observing your physical self’s actions and assuming ownership of them

Oh boy. Now here's the rub. We know this is true at least sometimes. When you make a decision and explain it, it is often(always?) just a post-hoc rationalization. You don't actually know why you make a lot of the decision you do even if you dearly believe so.

Re: Telling GPT-4 you're scared or under pressure improves performance

#168
post #64

Is this an emotional trigger or does this simply steer it towards answer/content in the dataset where someone actually spent time answering because the poster made it clear it’s very important to them?

There's no dataset to "steer to" or "match". LLMs don't memorize the vast majority of what they train on.

In the simplest form, the LLM has learnt that these kind of "emotional inputs" change the output in a meaningful way. It has learnt how to model this change.

For all intents and purposes, it is an emotional trigger.

Re: Telling GPT-4 you're scared or under pressure improves performance

#169

Earlier quoted context omitted.

> an implementation detail Yip, so I deny this premise. I take it to be the heart of the matter. > we might as well throw away 80% of our current scientific understanding Yip, i'd be down for that. Though maybe i'd say, 30-40%. Science in the strongest sense has no theory-building need for statistics. Those areas of science which have only statistical models, and not causal-ontological ones aren't science -- and i'd…

>How does associative statical modelling do? It takes averages of past shadows, and calls the cause of the shadow that average: this is pseudoscience. Quite correct! Throw it all away. It does not work this way at all. In any sense. For one thing, it does not try to draw shadows. This would not be possible of so. https://www.pnas.org/doi/full/10.1073/pnas.2016239118 Transformers or predictors are not trying to draw s…

Unsupervised learning on discrete data is just ensembling modes.

But let's look at how that helps in some cases.

So if we already know the object is a cup, and we know how it's positioned, then its shadow is an actual guide to its particular geometry.

So in cases where we have enough a priori scientific information, we can rig datasets (shadows) to be informative of the target domain.

Here the target is discrete: say the peaks and tips of a mountain line. Now can we rig a photo of a mountain to have in its ink an informative structure?

Sure. Now if we didn't know it was a mounting apparent peaks aren't even 'peaks' at all, they're just patterns of ink.

A priori explanatory models are needed to rig data for statistical modelling.

No such rigging can take place absent them

And with them, we aren't really discovering any new science -- rather we're gaining highly particular knowledge typically useful in engineering

Biologists in these areas describe this research as quite trivial low-hangimg fruit. It's not of much research interest just to automate these kinds of investigations

My masters was on a very similar project applied to quantum metrology -- it's always 'useful' but it's always also just a kind of engineering utility. We couldn't even do it if we hadn't already done the science

Re: Telling GPT-4 you're scared or under pressure improves performance

#170

Earlier quoted context omitted.

So I was with a financial researcher recently, and he wanted to use ChatGPT to summarise some reference financial data -- and it did so, actually correctly. Being sceptical, as every person ought in these matters, I changed the finical data and performed the same analysis (both in a new tab, and within the same convo). The results were the same! How strange? Well, in being reference financial data ChatGPT was reporti…

>Since it's incapable of actually summarising financial data. It's only capable of selecting combinations of pieces of its training set. Third completely off misconception from you today. This is not at all what it is doing. "Supercharged Interpolation" is false and makes no sense. It's not a lookup table either. It doesn't memorize enough of what it needs to to make your assertion possible. https://arxiv.org/abs/211…

at 500gb, you can store nearly everything ever written -- let alone compressed.

all statistical learning is a variation on k-nn (see the relevant paper on this) but likewise this is obvious a priori

k-nn is the ideal learner, and a good starting point for analysis

the question for any given system is: what is the learning space, what is the distance function, and how many points are being considered

NNs set up a compressed X,y space, in that space choose points via an empirical expectation, and obtain a weighted average as their prediction

That's just what they do -- there isn't any other mechanism here. The whole formal structure of the NN can be written down on a page of paper

your paper above doesn't deal with this -- it's a reply to the 'forced interpolation' view, which i haven't espoused. but often NNs are forced interpolated

'extrapolation' is of course a part of the possible predictive output of a statical learning system -- in that it's latent space is taken to be embedded in R^n and so one can 'veer off' into R.

Whenever you attribute a higher fidelity space to a small latent space you are, in effect, extrapolating

Post reply on HN