Annoying, but easy to mitigate: add "be critical" to Claude.md or whatever.
Claude says “You're absolutely right!” about everything
51–60 of 560 posts
Re: Claude says “You're absolutely right!” about everything
#52You're absolutely right! I also get this too often, when I sometimes say something like "would it be maybe better to do it like this?" and then it replies that I'm absolutely right, and starts writing new code. While I was rather wondering what Claude may think and advice me whether that's the best way to go forward.
Re: Claude says “You're absolutely right!” about everything
#53There are cultures where “I don’t think that is a good idea” is not something an AI servant should ever say, and there are cultures where that’s perfectly acceptable.
Re: Claude says “You're absolutely right!” about everything
#54Earlier quoted context omitted.
> And research articles indicate that when the model computes that it should employ sycophantism it becomes less useful in every other way, just like a real sycophant. The end goal of a sycophant is to gain advantage with their flattery. If sycophant behavior gets Claude's users to favour Claude over other competing LLM services, they prove to be more useful to the service provider.
Until users find out it's less useful to the user because of that. Or it causes some tragedies...
If there is no web-search, only googling, it doesn't matter how bad the results are for the user as long as the customer gets what they paid for.
Re: Claude says “You're absolutely right!” about everything
#55Earlier quoted context omitted.
Until users find out it's less useful to the user because of that. Or it causes some tragedies...
The problem is that the majority of user interaction doesn't need to be "useful" (as in increasing productivity): the majority of users are looking for entertainment, so turning up the sycophancy knob makes sense from a commercial point of view. It's just like adding sugar in foods and drinks.
Re: Claude says “You're absolutely right!” about everything
#56Earlier quoted context omitted.
Until users find out it's less useful to the user because of that. Or it causes some tragedies...
The problem is that the majority of user interaction doesn't need to be "useful" (as in increasing productivity): the majority of users are looking for entertainment, so turning up the sycophancy knob makes sense from a commercial point of view. It's just like adding sugar in foods and drinks.
I'm not so sure sycophancy is best for entertainment, though. Some of the most memorable outputs of AI dungeon (an early GPT-2 based dialog system tuned to mimic a vaguely Zork-like RPG) was when the bot gave the impression of being fed up with the player's antics.
Re: Claude says “You're absolutely right!” about everything
#57Re: Claude says “You're absolutely right!” about everything
#58Earlier quoted context omitted.
Until users find out it's less useful to the user because of that. Or it causes some tragedies...
The problem is that the majority of user interaction doesn't need to be "useful" (as in increasing productivity): the majority of users are looking for entertainment, so turning up the sycophancy knob makes sense from a commercial point of view. It's just like adding sugar in foods and drinks.
Re: Claude says “You're absolutely right!” about everything
#59You're absolutely right! I also get this too often, when I sometimes say something like "would it be maybe better to do it like this?" and then it replies that I'm absolutely right, and starts writing new code. While I was rather wondering what Claude may think and advice me whether that's the best way to go forward.
Re: Claude says “You're absolutely right!” about everything
#60Not Claude but ChatGPT - I asked it to pipe down on exactly that kind of response. And it did.
> If you’d like, I can demonstrate…
or
> If you want…
and that's /after/ I put in instructions to not do it.