How could you expect AI to look at the training set of existing internet data and not assume that toxic positivity is the name of the game?
Claude says “You're absolutely right!” about everything
361–370 of 560 posts
Re: Claude says “You're absolutely right!” about everything
#362And the fact that they skimp a bit on reasoning tokens / compute, makes it even worse.
Re: Claude says “You're absolutely right!” about everything
#363Earlier quoted context omitted.
Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.
We should all be deeply worried about gpt being used as a therapist. My friend told me he was using his to help him evaluate how his social interactions went (and ultimately how to get his desired outcome) and I warned him very strongly about the kind of bias it will creep into with just "stroking your ego" - There's already been articles on people going off the deep end in conspiracy theories etc - because the ai ke…
>[...] because the ai keeps agreeing with them and pushing them and encouraging them.
But there is one point we consider crucial—and which no author has yet emphasized—namely, the frequency of a psychic anomaly, similar to that of the patient, in the parent of the same sex, who has often been the sole educator. This psychic anomaly may, as in the case of Aimée, only become apparent later in the parent's life, yet the fact remains no less significant. Our attention had long been drawn to the frequency of this occurrence. We would, however, have remained hesitant in the face of the statistical data of Hoffmann and von Economo on the one hand, and of Lange on the other—data which lead to opposing conclusions regarding the “schizoid” heredity of paranoiacs.
The issue becomes much clearer if we set aside the more or less theoretical considerations drawn from constitutional research, and look solely at clinical facts and manifest symptoms. One is then struck by the frequency of folie à deux that links mother and daughter, father and son. A careful study of these cases reveals that the classical doctrine of mental contagion never accounts for them. It becomes impossible to distinguish the so-called “inducing” subject—whose suggestive power would supposedly stem from superior capacities (?) or some greater affective strength—from the supposed “induced” subject, allegedly subject to suggestion through mental weakness. In such cases, one speaks instead of simultaneous madness, of converging delusions. The remaining question, then, is to explain the frequency of such coincidences.
Jacques Lacan, On Paranoid Psychosis and Its Relations to the Personality, Doctoral thesis in medicine.
Re: Claude says “You're absolutely right!” about everything
#364Earlier quoted context omitted.
It doesn't know. It was trained and probably instructed by the system to be positive and reassuring.
They actually feel like they were trained to be both extremely humble and at the same time, excited to serve. As if it were an intern talking to his employer's CEO. I suspect AI companies executive leadership, through their feedback to their devs about Claude, ChatGPT, Gemini, and so on, are unconsciously shaping the tone and manner of their LLM product's speech. They are used to be talked to like this, so their prod…
There's nobody there, it's just weights and words, but what's going on that such a coding assistant will echo emotional slants like THAT? It's certainly not being instructed to self-abase like that, at least not directly, so what's going on in the training data?
Re: Claude says “You're absolutely right!” about everything
#365Earlier quoted context omitted.
There is evidence from Reddit that particularly women used GPT-4o as their AI "boyfriend". I think that's unhealthy behavior and it is probably net positive that GPT-5 doesn't do that anymore.
Why is it unhealthy? If you just want a good word that you don't have in your life why should you bother another person if machine can do it?
Re: Claude says “You're absolutely right!” about everything
#366Earlier quoted context omitted.
I have this same problem. I’ve added a bunch of instructuons to try and stop ChatGPT being so sycophantic, and now it always mentions something about how it’s going to be ‘straight to the point’ or give me a ‘no bs version’. So now I just have that as the intro instead of ‘that’s a sharp observation’
I had instructions added too and it is doing exactly what you say. And it does it so many times in a voice chat. It's really really annoying.
AVM already seems to use a different, more conversational model than text chat -- really wish there were a reliable way to customize it better.
Re: Claude says “You're absolutely right!” about everything
#367Earlier quoted context omitted.
As a Finn, it makes me want to use it much, much less if it kisses ass.
Finns need to mentally evolve beyond this mindset. Somebody being polite and friendly to you does not mean that the person is inferior to you and that you should therefore despise them. Likewise somebody being rude and domineering to you does not mean that they are superior to you and should be obeyed and respected. Politeness is a tool and a lubricant, and Finns probably loose out on a lot of international business…
We are also talking about a tool here. I don't want fluff from a tool, I want the thing I'm seeking from the tool, and in this case it's info. Adding fluff just annoys me because it takes more mental power to skip all the irrelevant parts.
Re: Claude says “You're absolutely right!” about everything
#368"You're absolutely right" (song) https://www.reddit.com/r/ClaudeAI/comments/1mep2jo/youre_abs...
Re: Claude says “You're absolutely right!” about everything
#369Earlier quoted context omitted.
Is that GPT5? Reddit users are freaking out about losing 4o and AFAICT it's because 5 doesn't stroke their ego as hard as 4o. I feel there are roughly two classes of heavy LLM users - one who use it like a tool, and the other like a therapist. The latter may be a bigger money maker for many LLM companies so I worry GPT5 will be seen as a mistake to them, despite being better for research/agent work.
We should all be deeply worried about gpt being used as a therapist. My friend told me he was using his to help him evaluate how his social interactions went (and ultimately how to get his desired outcome) and I warned him very strongly about the kind of bias it will creep into with just "stroking your ego" - There's already been articles on people going off the deep end in conspiracy theories etc - because the ai ke…
Re: Claude says “You're absolutely right!” about everything
#370I've fought with this in informal (non-technical) sessions with ChatGPT, where I was asking analysis questions about... stuff that interests me... and ChatGPT would always reply: "You're absolutely right!" "You are asking exactly the right questions!" "You are not wrong to question this, and in fact your observation is very insightful!" At first this is encouraging, which is why I suspect OpenAI uses a pre-prompt to…