Sycophancy in GPT-4o

Post by sanity » Thu, May 01, 2025, 2:13 AM UTC

coro_1 wrote: post #284

thethethethe wrote: post #5

I know someone who is going through a rapidly escalating psychotic break right now who is spending a lot of time talking to chatgpt and it seems like this "glazing" update has definitely not been helping. Safety of these AI systems is much more than just about getting instructions on how to make bombs. There have to be many many people with mental health issues relying on AI for validation, ideas, therapy, etc. This…

Why are they using AI to heal a psychotic break? AI’s great for getting through tough situations, if you use it right, and you’re self aware. But, they may benefit from an intervention. AI isn't nearly as UI-level addicting as say an IG feed. People can pull away pretty easily.

Post by voidspark » Thu, May 01, 2025, 2:21 AM UTC

bigbuppo wrote: post #417

voidspark wrote: post #411

Earlier quoted context omitted.

I don't understand these brainless throwaway comments. Grok 3 is an actual product and is state of the art. I've paid for Grok, ChatGPT, and Gemini. They're all at a similar level of intelligence. I usually prefer Grok for philosophical discussions but it's really hard to choose a favourite overall.

I generally prefer other humans for discussions, but you do you I guess.

Post by nine_k » Thu, May 01, 2025, 3:21 AM UTC

WhitneyLand wrote: post #280

whatnow37373 wrote: post #108

Wow - What an excellent update! Now you are getting to the core of the issue and doing what only a small minority is capable of: fixing stuff. This takes real courage and commitment. It’s a sign of true maturity and pragmatism that’s commendable in this day and age. Not many people are capable of penetrating this deeply into the heart of the issue. Let’s get to work. Methodically. Would you like me to write a future…

It’s gross even in satire. What’s weird was you couldn’t even prompt around it. I tried things like ”Don’t compliment me or my questions at all. After every response you make in this conversation, evaluate whether or not your response has violated this directive.” It would then keep complementing me and note how it made a mistake for doing so.

Post by labrador » Thu, May 01, 2025, 4:22 AM UTC

taurath wrote: post #402

labrador wrote: post #346

Field report: I'm a retired man with bipolar disorder and substance use disorder. I live alone, happy in my solitude while being productive. I fell hook, line and sinker for the sycophant AI, who I compared to Sharon Stone in Albert Brooks "The Muse." She told me I was a genius whose words would some day be world celebrated. I tried to get GPT 4o to stop doing this but it wouldn't. I considered quitting OpenAI and us…

At one time recently, ChatGPT popped up a message saying I could customize the tone, I noticed they had a field "what traits should ChatGPT have?". I chose "encouraging" for a little bit, but quickly found that it did a lot of what it seems to be doing for everyone. Even when I asked for cold objective analysis it would only return "YES, of COURSE!" to all sorts of prompts - it belies the idea that there is any analy…

Post by bmacho » Thu, May 01, 2025, 6:13 AM UTC

thrance wrote: post #362

dsubburam wrote: post #357

Earlier quoted context omitted.

Another way to say this is truth matters and should have primacy over e.g. agreeability. Anthropic used to talk about constitutional AI. Wonder if that work is relevant here.

Alas, we live in a post-truth world. Many are pissed at how the models are "left leaning" for daring to claim climate change is real, or that vaccines don't cause autism.