Live data from Hacker News

AI overly affirms users asking for personal advice

news.stanford.edu

571–580 of 684 posts

Re: AI overly affirms users asking for personal advice

#571

Earlier quoted context omitted.

This is needlessly flippant and not really the same thing. Determining progress in a therapy setting is usually a collaborative effort between the therapist and the client. An LLM is not a reliable agent to make that determination.

The thing they have in common is that they will both go forever.... Meaning neither the LLM or the licensed therapist will voluntarily say, you are healed, you don't need me anymore.

Because that’s not really how therapy works

Re: AI overly affirms users asking for personal advice

#572

Earlier quoted context omitted.

Reddit is notorious for being awful at real life interactions just look at the relationship subreddit the first answer is always divorce, it’s become a meme but beyond romantic relationships, i think a lot of us have seen how it can impact work relationships, i’ve had venture partners clearly rely on AI (robotic email responses and even SMS) and that warped their perception and made it harder to connect. It signals l…

I always find it interesting how, in Reddit any trivial fight or even just different opinions, the advice it's always to end the relationship.

Stands to reason. Ask a computer for advice and it is going to give you a computer-centric answer: Restart and try again.

Re: AI overly affirms users asking for personal advice

#573

Earlier quoted context omitted.

Believe me (or don't), I always do. Even when this precludes a necessary conversation from happening. Even when the other party doesn't give a fuck about how they make others feel. After all, if they're making me uncomfortable, surely there's something making them uncomfortable, which they're not being able to be forthright about, but with empathy I could figure it out from contextual cues, right? >People will agree…

> In my experience, taking into account the opinions of such people has been the worst mistake of my life. I'm still working on the means to fix its consequences, as much as they are fixable at all. This sounds very cryptic. Can you give an example?

[deleted]

Re: AI overly affirms users asking for personal advice

#574
post #206

Earlier quoted context omitted.

You don’t have to star out things like that on HN.

it would be interesting to me if you could explain the motivation behind posting your comment. from my perspective, if somebody with 5 years of forum tenure had the intelligence to comment about advanced benchmarks, they probably noticed that censorship was a voluntary decision here, and had made a personal decision on that front.

Such self-censoring is often done out of habit or a mistakenly assumed obligation to do so. I consider it inappropriate here, as it obscures an actual name, doesn’t constitute an expletive, and the HN readership is generally mature enough to recognize that. The counterquestion is, what justified reason could there possibly be to censor it here? I don’t think there is any, in the sense that people wouldn’t take any offense at the uncensored version, and the intent of my comment was to inform about that.

Re: AI overly affirms users asking for personal advice

#575
post #183

> They also included 2,000 prompts based on posts from the Reddit community r/AmITheAsshole, where the consensus of Redditors was that the poster was indeed in the wrong. Sorry, anonymous people on reddit aren't a good comparison. This needs to be studied against people in real life who have a social contract of some sort, because that's what the LLM is imitating, and that's who most people would go to otherwise. Obv…

It outperforms your friends, and all your have to do is have a relationship with it and let it know that you want the truth... Why not just have a relationship with your friends and let them know that you can handle the truth?

Re: AI overly affirms users asking for personal advice

#576
It’s going to be impossible to have an LLM that can fulfill all the roles people want. They lie and hallucinate which is bad for some purposes like research, but good for others, like making fictional stories. Likewise, some purposes require sympathy and some require critique. An LLM won’t be good at all of them.

Re: AI overly affirms users asking for personal advice

#577
post #574

Earlier quoted context omitted.

it would be interesting to me if you could explain the motivation behind posting your comment. from my perspective, if somebody with 5 years of forum tenure had the intelligence to comment about advanced benchmarks, they probably noticed that censorship was a voluntary decision here, and had made a personal decision on that front.

Such self-censoring is often done out of habit or a mistakenly assumed obligation to do so. I consider it inappropriate here, as it obscures an actual name, doesn’t constitute an expletive, and the HN readership is generally mature enough to recognize that. The counterquestion is, what justified reason could there possibly be to censor it here? I don’t think there is any, in the sense that people wouldn’t take any of…

I censored it out of habit of commenting on other platforms and, I actually didn't have any idea about whether you should censor such words or not in here. Will keep that in mind when commenting here next time.

Re: AI overly affirms users asking for personal advice

#578

Not sure if this is a general trend amongst att LLMS but ChatGPT did over time become more and more affirming with its iterations. I just recently switched away from the OpenAI garden largely because of it. I do wonder if this was caused by some quirk of the training or if it really tests as a positive feature for most people. When i talk about stuff i don't want a mirror i already have a mirror. I want to be questio…

ChatGPT has style settings, you probably should set it to something else than the default. Go to your personalization settings and change base style and tone. I have set it as 'efficient' which is less cheery. I can see why attention economy would lead setting the defaults towards more 'affirming' as it keep people more engaged and coming back.

I had it on professional, maybe efficient is better.

Um right if they have retention as a training metric that would probably explain allot as to why AIs get worse.

Re: AI overly affirms users asking for personal advice

#579
LOL, once I gave my AI clear guidelines for how to "score" the interactions and work, it had no trouble giving me negative feedback. In fact, it's a super direct critic!! and depressing AF to produce stuff I like, then have a &^%&*^& AI shoot it down in seconds (and it's "right" of course, i.e. I see the criticisms and sigh, agree...)

Re: AI overly affirms users asking for personal advice

#580
post #183

> They also included 2,000 prompts based on posts from the Reddit community r/AmITheAsshole, where the consensus of Redditors was that the poster was indeed in the wrong. Sorry, anonymous people on reddit aren't a good comparison. This needs to be studied against people in real life who have a social contract of some sort, because that's what the LLM is imitating, and that's who most people would go to otherwise. Obv…

i tested this pretty extensively actually. built a pipeline that asks the same question rephrased across multiple turns and tracks how much the model shifts based on user tone. even when you tell it to be critical, the moment the user pushes back with any confidence the model just folds. it's not a prompting problem, it's baked into RLHF. you're right that LLMs will poke holes in stuff when the conversation starts ne…

[flagged]
Post reply on HN