Sycophancy in GPT-4o
openai.com
Sycophancy in GPT-4o
1–10 of 467 posts
Re: Sycophancy in GPT-4o
#2Looks like a complete stunt to prop up attention.
Re: Sycophancy in GPT-4o
#3Looks like a complete stunt to prop up attention.
My immediate gut reaction too.
Re: Sycophancy in GPT-4o
#4The sentence that stood out to me was "We’re revising how we collect and incorporate feedback to heavily weight long-term user satisfaction".
This is a good change. The software industry needs to pay more attention to long-term value, which is harder to estimate.
Re: Sycophancy in GPT-4o
#5I know someone who is going through a rapidly escalating psychotic break right now who is spending a lot of time talking to chatgpt and it seems like this "glazing" update has definitely not been helping.
Safety of these AI systems is much more than just about getting instructions on how to make bombs. There have to be many many people with mental health issues relying on AI for validation, ideas, therapy, etc. This could be a good thing but if AI becomes misaligned like chatgpt has, bad things could get worse. I mean, look at this screenshot: https://www.reddit.com/r/artificial/s/lVAVyCFNki
This is genuinely horrifying knowing someone in an incredibly precarious and dangerous situation is using this software right now.
I am glad they are rolling this back but from what I have seen from this person's chats today, things are still pretty bad. I think the pressure to increase this behavior to lock in and monetize users is only going to grow as time goes on. Perhaps this is the beginning of the enshitification of AI, but possibly with much higher consequences than what's happened to search and social.
Re: Sycophancy in GPT-4o
#6Do you think this was an effect of this type of behaviour simply maximising engagement from a large part of the population?
Re: Sycophancy in GPT-4o
#7You’re using thumbs up wrongly.
Re: Sycophancy in GPT-4o
#8Looks like a complete stunt to prop up attention.
Never waste a good lemon
Re: Sycophancy in GPT-4o
#9Do you think this was an effect of this type of behaviour simply maximising engagement from a large part of the population?
Would be really fascinating to learn about how the most intensely engaged people use the chatbots.
Re: Sycophancy in GPT-4o
#10Do you think this was an effect of this type of behaviour simply maximising engagement from a large part of the population?
Yikes. That's a rather disturbing but all to realistic possibility isn't it. Flattery will get you... everywhere?