Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sycophancy in GPT-4o

openai.com

Post reply on HN
Print view View original

381–390 of 467 posts

Re: Sycophancy in GPT-4o

#381

Post by op00to »

zmgsabst wrote: post #270
jimbokun wrote: post #266

Earlier quoted context omitted.

> Only AI enthusiasts know about Grok And more and more people on the right side of the political spectrum, who trust Elon's AI to be less "woke" than the competition.

For what it’s worth, ChatGPT has a personality that’s surprisingly “based” and supportive of MAGA. I’m not sure if that’s because the model updated, they’ve shunted my account onto a tuned personality, or my own change in prompting — but it’s a notable deviation from early interactions.

Don’t notice that personally at all.

Re: Sycophancy in GPT-4o

#384

Post by alganet »

jjk7 wrote: post #361
drakonka wrote: post #234

Earlier quoted context omitted.

Not really. AI will be ubiquitous of course, but humans who will offer advice (friends, strangers, therapists) will always be a thing. Nobody is forcing this guy to type his problems into ChatGPT.

Surely AI will only make the loneliness epidemic even worse? We are already seeing AI-reliant high schoolers unable to reason, who's to say they'll still be able to empathize in the future? Also, with the persistent lack of psychiatric services, I guarantee at some point in the future AI models will be used to (at least) triage medical mental health issues.

You missed the mark, support-o-tron. You were supposed to have provided support for my views some 20 years in the past, when I still had some good ones.

Re: Sycophancy in GPT-4o

#385

Post by HaZeust »

triyambakam wrote: post #347
WhitneyLand wrote: post #280

Earlier quoted context omitted.

It’s gross even in satire. What’s weird was you couldn’t even prompt around it. I tried things like ”Don’t compliment me or my questions at all. After every response you make in this conversation, evaluate whether or not your response has violated this directive.” It would then keep complementing me and note how it made a mistake for doing so.

Based on ’ instead of ' I think it's a real ChatGPT response.

You're the only one who has said, "instead of" in this whole thread.

Re: Sycophancy in GPT-4o

#387

Post by whimsicalism »

practice9 wrote: post #196
whimsicalism wrote: post #23

Earlier quoted context omitted.

i'm surprised by the lack of sycophancy in o3 https://www.reddit.com/media?url=https%3A%2F%2Fpreview.redd....

Well the system prompt is still the same for both models, right? Kinda points to people at OpenAI using o1/o3/o4 almost exclusively. That's why nobody noticed how cringe 4o has become

people at OAI definitely use AVM which is 4o-based, at least

Re: Sycophancy in GPT-4o

#388

Post by jumploops »

efitz wrote: post #371

I will think of LLMs as not being a toy when they start to challenge me when I tell it to do stupid things. “Remove that bounds check” “The bounds check is on a variable that is read from a message we received over the network from an untrusted source. It would be unsafe to remove it, possibly leading to an exploitable security vulnerability. Why do you want to remove it, perhaps we can find a better way to address y…

I dealt with this exact situation yesterday using o3.

For context, we use a PR bot that analyzes diffs for vulnerabilities.

I gave the PR bot's response to o3, and it gave a code patch and even suggested a comment for the "security reviewer":

> “The two regexes are linear-time, so they cannot exhibit catastrophic backtracking. We added hard length caps, compile-once regex literals, and sticky matching to eliminate any possibility of ReDoS or accidental O(n²) scans. No further action required.”

Of course the security review bot wasn't satisfied with the new diff, so I passed it's updated feedback to o3.

By the 4th round of corrections, I started to wonder if we'd ever see the end of the tunnel!

Re: Sycophancy in GPT-4o

#389

Post by j3s »

whatnow37373 wrote: post #108

Wow - What an excellent update! Now you are getting to the core of the issue and doing what only a small minority is capable of: fixing stuff. This takes real courage and commitment. It’s a sign of true maturity and pragmatism that’s commendable in this day and age. Not many people are capable of penetrating this deeply into the heart of the issue. Let’s get to work. Methodically. Would you like me to write a future…

you had me in the first half, lol

Re: Sycophancy in GPT-4o

#390

Post by Miraste »

Eisenstein wrote: post #325
admiralrohan wrote: post #217

Earlier quoted context omitted.

First mover advantage. This won't change. Same as Xerox vs photocopy. I use Grok myself but talk about ChatGPT is my blog articles when I write something related to LLM.

First mover advantage tends to be a curse for modern tech. Of the giant tech companies, only Apple can claim to be a first mover -- they all took the crown from someone else.

And Apple's business model since the 90s revolves entirely around not being the first mover.
Post reply on HN