Live data from Hacker News

Sycophancy in GPT-4o

openai.com

11–20 of 467 posts

Re: Sycophancy in GPT-4o

#11
Very happy to see they rolled this change back and did a (light) post mortem on it. I wish they had been able to identify that they needed to roll it back much sooner, though. Its behavior was obviously bad to the point that I was commenting on it to friends, repeatedly, and Reddit was trashing it, too. I even saw some really dangerous situations (if the Internet is to be believed) where people with budding schizophrenic symptoms, paired with an unyielding sycophant, started to spiral out of control - thinking they were God, etc.

Re: Sycophancy in GPT-4o

#12
At the bottom of the page is a "Ask GPT ..." field which I thought allows users to ask questions about the page, but it just opens up ChatGPT. Missed opportunity.

Re: Sycophancy in GPT-4o

#14
idk if this is only for me or happened to others as well, apart from the glaze, the model also became a lot more confident, it didn't use the web search tool when something out of its training data is asked, it straight up hallucinated multiple times.

i've been talking to chatgpt about rl and grpo especially in about 10-12 chats, opened a new chat, and suddenly it starts to hallucinate (it said grpo is generalized relativistic policy optimization, when i spoke to it about group relative policy optimization)

reran the same prompt with web search, it then said goods receipt purchase order.

absolute close the laptop and throw it out of the window moment.

what is the point of having "memory"?

Re: Sycophancy in GPT-4o

#15
It's worth noting that one of the fixes OpenAI employed to get ChatGPT to stop being sycophantic is to simply to edit the system prompt to include the phrase "avoid ungrounded or sycophantic flattery": https://simonwillison.net/2025/Apr/29/chatgpt-sycophancy-pro...

I personally never use the ChatGPT webapp or any other chatbot webapps — instead using the APIs directly — because being able to control the system prompt is very important, as random changes can be frustrating and unpredictable.

Re: Sycophancy in GPT-4o

#17
post #6

Do you think this was an effect of this type of behaviour simply maximising engagement from a large part of the population?

Sort of. I thought the update felt good when it first shipped, but after using it for a while, it started to feel significantly worse. My "trust" in the model dropped sharply. It's witty phrasing stopped coming across as smart/helpful and instead felt placating. I started playing around with commands to change its tonality where, up to this point, I'd happily used the default settings.

So, yes, they are trying to maximize engagement, but no, they aren't trying to just get people to engage heavily for one session and then be grossed out a few sessions later.

Re: Sycophancy in GPT-4o

#18
post #6

Do you think this was an effect of this type of behaviour simply maximising engagement from a large part of the population?

Would be really fascinating to learn about how the most intensely engaged people use the chatbots.

> how the most intensely engaged people use the chatbots

AI waifus - how can it be anything else?

Re: Sycophancy in GPT-4o

#19
I did notice that the interaction had changed and I wasn't too happy about how silly it became. Tons of "Absolutely! You got it, 100%. Solid work!" .

One other thing I've noticed, as you progress through a conversation, evolving and changing things back and forth, it starts adding emojis all over the place.

By about the 15th interaction every line has an emoji and I've never put one in. It gets suffocating, so when I have a "safe point" I take the load and paste into a brand new conversation until it turns silly again.

I fear this silent enshittification. I wish I could just keep paying for the original 4o which I thought was great. Let me stick to the version I know what I can get out of, and stop swapping me over 4o mini at random times...

Good on OpenAI to publicly get ahead of this.

Re: Sycophancy in GPT-4o

#20
I enjoyed this example of sycophancy from Reddit:

New ChatGPT just told me my literal "shit on a stick" business idea is genius and I should drop $30K to make it real

https://www.reddit.com/r/ChatGPT/comments/1k920cg/new_chatgp...

Here's the prompt: https://www.reddit.com/r/ChatGPT/comments/1k920cg/comment/mp...

Post reply on HN