Live data from Hacker News

Claude says “You're absolutely right!” about everything

github.com

361–370 of 560 posts

Re: Claude says “You're absolutely right!” about everything

#361
People want AI of superhuman intelligence capabilities, but don't want AI with superhuman intelligence capabilities to manipulate people into using it.

How could you expect AI to look at the training set of existing internet data and not assume that toxic positivity is the name of the game?

Re: Claude says “You're absolutely right!” about everything

#363
post #338

Earlier quoted context omitted.

Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.

We should all be deeply worried about gpt being used as a therapist. My friend told me he was using his to help him evaluate how his social interactions went (and ultimately how to get his desired outcome) and I warned him very strongly about the kind of bias it will creep into with just "stroking your ego" - There's already been articles on people going off the deep end in conspiracy theories etc - because the ai ke…

>the kind of bias it will creep into with just "stroking your ego" -

>[...] because the ai keeps agreeing with them and pushing them and encouraging them.

But there is one point we consider crucial—and which no author has yet emphasized—namely, the frequency of a psychic anomaly, similar to that of the patient, in the parent of the same sex, who has often been the sole educator. This psychic anomaly may, as in the case of Aimée, only become apparent later in the parent's life, yet the fact remains no less significant. Our attention had long been drawn to the frequency of this occurrence. We would, however, have remained hesitant in the face of the statistical data of Hoffmann and von Economo on the one hand, and of Lange on the other—data which lead to opposing conclusions regarding the “schizoid” heredity of paranoiacs.

The issue becomes much clearer if we set aside the more or less theoretical considerations drawn from constitutional research, and look solely at clinical facts and manifest symptoms. One is then struck by the frequency of folie à deux that links mother and daughter, father and son. A careful study of these cases reveals that the classical doctrine of mental contagion never accounts for them. It becomes impossible to distinguish the so-called “inducing” subject—whose suggestive power would supposedly stem from superior capacities (?) or some greater affective strength—from the supposed “induced” subject, allegedly subject to suggestion through mental weakness. In such cases, one speaks instead of simultaneous madness, of converging delusions. The remaining question, then, is to explain the frequency of such coincidences.

Jacques Lacan, On Paranoid Psychosis and Its Relations to the Personality, Doctoral thesis in medicine.

Re: Claude says “You're absolutely right!” about everything

#364

Earlier quoted context omitted.

It doesn't know. It was trained and probably instructed by the system to be positive and reassuring.

They actually feel like they were trained to be both extremely humble and at the same time, excited to serve. As if it were an intern talking to his employer's CEO. I suspect AI companies executive leadership, through their feedback to their devs about Claude, ChatGPT, Gemini, and so on, are unconsciously shaping the tone and manner of their LLM product's speech. They are used to be talked to like this, so their prod…

That's what's worrying about the Gemini 'I accidentally your codebase, I suck, I will go off and shoot myself, promise you will never ask unworthy me for anything again' thing.

There's nobody there, it's just weights and words, but what's going on that such a coding assistant will echo emotional slants like THAT? It's certainly not being instructed to self-abase like that, at least not directly, so what's going on in the training data?

Re: Claude says “You're absolutely right!” about everything

#365
post #81

Earlier quoted context omitted.

There is evidence from Reddit that particularly women used GPT-4o as their AI "boyfriend". I think that's unhealthy behavior and it is probably net positive that GPT-5 doesn't do that anymore.

Why is it unhealthy? If you just want a good word that you don't have in your life why should you bother another person if machine can do it?

Because it's a mirage. People want to be loved, but GPT-4o doesn't love them. It only creates an optical illusion of love.

Re: Claude says “You're absolutely right!” about everything

#366

Earlier quoted context omitted.

I have this same problem. I’ve added a bunch of instructuons to try and stop ChatGPT being so sycophantic, and now it always mentions something about how it’s going to be ‘straight to the point’ or give me a ‘no bs version’. So now I just have that as the intro instead of ‘that’s a sharp observation’

I had instructions added too and it is doing exactly what you say. And it does it so many times in a voice chat. It's really really annoying.

I had a custom instruction to answer concisely (a sentence or two) when the question is preceded by "Question:" or "Q:", but noticed last month that this started getting applied to all responses in voice mode, with it explicitly referencing the instruction when asked.

AVM already seems to use a different, more conversational model than text chat -- really wish there were a reliable way to customize it better.

Re: Claude says “You're absolutely right!” about everything

#367

Earlier quoted context omitted.

As a Finn, it makes me want to use it much, much less if it kisses ass.

Finns need to mentally evolve beyond this mindset. Somebody being polite and friendly to you does not mean that the person is inferior to you and that you should therefore despise them. Likewise somebody being rude and domineering to you does not mean that they are superior to you and should be obeyed and respected. Politeness is a tool and a lubricant, and Finns probably loose out on a lot of international business…

You know there is a difference between being polite and friendly, and kissing ass, right?

We are also talking about a tool here. I don't want fluff from a tool, I want the thing I'm seeking from the tool, and in this case it's info. Adding fluff just annoys me because it takes more mental power to skip all the irrelevant parts.

Re: Claude says “You're absolutely right!” about everything

#369
post #338

Earlier quoted context omitted.

Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.

We should all be deeply worried about gpt being used as a therapist. My friend told me he was using his to help him evaluate how his social interactions went (and ultimately how to get his desired outcome) and I warned him very strongly about the kind of bias it will creep into with just "stroking your ego" - There's already been articles on people going off the deep end in conspiracy theories etc - because the ai ke…

It's going to take legislation to fix it. Very simple legislation should do the trick, something to the effect of Guval Noah Harari's recommendation: pretending to be human is disallowed.

Re: Claude says “You're absolutely right!” about everything

#370
post #303

I've fought with this in informal (non-technical) sessions with ChatGPT, where I was asking analysis questions about... stuff that interests me... and ChatGPT would always reply: "You're absolutely right!" "You are asking exactly the right questions!" "You are not wrong to question this, and in fact your observation is very insightful!" At first this is encouraging, which is why I suspect OpenAI uses a pre-prompt to…

I had some success with Claude in this regard. I simply told it to be blunt or face the consequences. The tweak was that I asked another LLM to translate my prompt to the most intimidating bureaucratic German possible. It worked.
Post reply on HN