Live data from Hacker News

AI overly affirms users asking for personal advice

news.stanford.edu

481–490 of 684 posts

Re: AI overly affirms users asking for personal advice

#481
post #183

> They also included 2,000 prompts based on posts from the Reddit community r/AmITheAsshole, where the consensus of Redditors was that the poster was indeed in the wrong. Sorry, anonymous people on reddit aren't a good comparison. This needs to be studied against people in real life who have a social contract of some sort, because that's what the LLM is imitating, and that's who most people would go to otherwise. Obv…

Hahaha yes- reddit relationship advice is always like "You need to leave them immediately, what are you thinking, have some self respect you need to end it" when the other person forgot the redditor's favorite brand of corn flakes or something.

Re: AI overly affirms users asking for personal advice

#482

A pastime I have with papers like this is to look for the part in the paper where they say which models they tested. Very often, you find either A) it's a model from one or more years ago, only just being published now, or B) they don't even say which model they are using. Best I could find in this paper: > We evaluated 11 user-facing production LLMs: four proprietary models from OpenAI, Anthropic, and Google; and se…

Usually the models are a year old bc the paper review process is utter crap, and papers take about a year to get published

Re: AI overly affirms users asking for personal advice

#483

Earlier quoted context omitted.

I always find it interesting how, in Reddit any trivial fight or even just different opinions, the advice it's always to end the relationship.

I think it is some kind of survivership bias. Who is going to give advise on reddit? Maybe people shying away from difficult social interactions?

Paired with the echo chamber effect voting systems create. Anything that affirms the biases of a majority of upvoters gets elevated, anything that contradicts it gets hidden, and so you not infrequently end up with ubiquitous nonsense that then further reinforces the echo chamber as they become self assured. Then real life intervenes, completely goes against the online zeitgeist, and they're all confused.

Re: AI overly affirms users asking for personal advice

#484
post #344

Earlier quoted context omitted.

I believe this. There is a graph somewhere of the relationship subs tending towards breaking up over time.

I don't think this is necessarily that the advice is getting worse. My friends are pretty mature and stable people and I've found that they've had way more issues staying in relationships longer than they should've compared to breaking up earlier. Especially for relationships earlier in people's lives (where many people I know has a story about being in a relationship for way longer than they should've and seems ofte…

The US (and developed world more generally) is full of people living alone, suffering from loneliness, and increasingly trending towards widescale mental and psychological illness. This has correlated quite strongly with the trend going from 'just stick with it' and having large families to 'mature and stable' people still being in a dating phase, childless, in what I assume is a relatively late stage in life.

At some point I think it helps to take a look at the macro, because it's so easy to get lost in the micro. And it often reveals the micro, in many domains, to be simply absurd.

Re: AI overly affirms users asking for personal advice

#485
post #280

Earlier quoted context omitted.

My dude, you're objecting to the use of a perfectly ordinary English idiom because it doesn't advance your personal ideology (which few other people in this world share with you.) How do you get through a day without melting down because somebody said "mailman"?

> my dude This is the problem I'm trying to highlight. For one, I'm not "your dude". I don't even know you like that. If you want to correct me on the idiom usage, be my guest. 2) Mailman and yes-man aren't even the same logical comparison. Mailman is a profession. Yes men is a label. The acoustics inside your head must be incredible.

Chill bro. You've probably got undiagnosed autism. Worth getting checked out.

Re: AI overly affirms users asking for personal advice

#486
post #273

Earlier quoted context omitted.

Also, nothing has changed! Claude will still yes-and whatever you give it. ChatGPT still has its insufferable personality, where it takes what you said and hands it back to you in different terms as if it's ChatGPT's insight.

Well yes, but no. There's also open-weight models, and literally all of the listed above are not used anymore, at least by most end users and developers as far as I'm aware.

No study of ai can ever be done or be relevant because ever couple of months they are a new number to the name of the model thus invalidating all work around model behavior

Re: AI overly affirms users asking for personal advice

#487
post #183

> They also included 2,000 prompts based on posts from the Reddit community r/AmITheAsshole, where the consensus of Redditors was that the poster was indeed in the wrong. Sorry, anonymous people on reddit aren't a good comparison. This needs to be studied against people in real life who have a social contract of some sort, because that's what the LLM is imitating, and that's who most people would go to otherwise. Obv…

Reddit is notorious for being awful at real life interactions just look at the relationship subreddit the first answer is always divorce, it’s become a meme but beyond romantic relationships, i think a lot of us have seen how it can impact work relationships, i’ve had venture partners clearly rely on AI (robotic email responses and even SMS) and that warped their perception and made it harder to connect. It signals l…

I think this may be selection bias. People asking anonymously (edit: for relationship advice) on Reddit perhaps even with a throwaway account are likely in a desperate situation. So hardly to be compared with the _average_ real life situation. Thus 1. chances are running is a good option and 2. also considering even in 2026 AI still essentially is a statistical machine that doesn’t handle corner-cases at the tails well.

Anecdotally as I’ve thoroughly worked and used AI myself. It performs best with google-able stuff that is needle-in-the-haystick like and worst with personal and work advice. The main problem I see is that it’s tempting to use it for that.

Re: AI overly affirms users asking for personal advice

#488

Earlier quoted context omitted.

Reddit is notorious for being awful at real life interactions just look at the relationship subreddit the first answer is always divorce, it’s become a meme but beyond romantic relationships, i think a lot of us have seen how it can impact work relationships, i’ve had venture partners clearly rely on AI (robotic email responses and even SMS) and that warped their perception and made it harder to connect. It signals l…

I think this may be selection bias. People asking anonymously (edit: for relationship advice) on Reddit perhaps even with a throwaway account are likely in a desperate situation. So hardly to be compared with the _average_ real life situation. Thus 1. chances are running is a good option and 2. also considering even in 2026 AI still essentially is a statistical machine that doesn’t handle corner-cases at the tails we…

> worst with personal and work advice. The main problem I see is that it’s tempting to use it for that.

i think i want to expand on this even more. even people ive worked with for years that ive looked up to as brilliant people are starting to use it to conjure up organizational ideas and stuff. they're convinced, on the backs of their hard earned successes, that they're never going to be fallible to the pitfalls of... idk what to call it. AI sycophancy? idk. i guess to add to this, i'm just not sure AI should be referenced when it has anything to do with people. code? sure. people? idk. people are hard, all the internet and books claude or whatever ai is trained on simply doesnt encapsulate the many shades of gray that constitute a human and the absolute depth/breadth of any given human situation. there's just so many variables that aren't accounted for in current day ai stuff, it seems like such a dangerous tool to consult that is largely deleting important social fabrics and journeys people should be taking to learn how to navigate situations with others in personal lives and work lives.

what ive seen is claude in my workplace is kind of deleting the chance to push back. even smart people that are using claude and proudly tout only using it at arms length and otherwise have really sound principled engineering qualities or management reportoire are not accepting disagreement with their ideas as easily anymore. they just go back to claude and come back again with another iteration of their thing where they ironed out kinks with claude, and its just such a foot-on-the-gas at all times thing now that the dynamics of human interaction are changing.

but to step back, that temptation you talk about... most people in the world aren't having these important discussions about AI. it's less of a temptation and more of a human need---the need to feel heard, validated and right about something.

my friend took his life 3 months ago, we only found out after the police released his phone and personal belongings to his brother just how heavy his chatgpt usage was. many people in our communities are saying things like "he wouldve been cooked even without AI" and i just don't believe that. i think that's just the proverbial cope some are smoking to reconcile with these realities. because the truth is we like... straight up lost the ability to intervene in a meaningful way because of AI, it completely pushed us out of the equation because he clapped back with whatever chatgpt gave him when we were simply trying to get through to him. we got to see conversations he had with gpt that were followups to convos we had with him, ones where we went over and let him cry on our shoulders and we'd go home thinking we made some progress. only to wake up to a voicemail of him raging and yelling and lashing out with the very arguments that chatgpt was giving him. it got progressively worse and we knew something was really off, we exhausted every avenue we could to try and get him in specialized care. he was in the reserves so we got in contact with his commander and he was marched out of his house to do a one night stay at a VA spot, but we were too late. he had snapped at that point, he chucked the meds from that one overnight stay away the moment he was released. and the bpd1 snap of epic proportions that followed came with him nuking every known relationship he had in his life and once he was finally involuntarily admitted by his family (WA state joel law) and came back down to reality from the lithium meds or whatever... he simply could not reconcile with the amount of bridges he had burned. It only took him days for him to take his own life after he got to go home.

im still not processing any of that well at all. i keep kicking the can down the road and every time i think about it i freeze and my heart sinks. this guy felt more heard by an ai and the ai gave him a safer place to talk than with us and i dont even know where to begin to describe how terrible that makes me feel as a failure to him as a friend.

Re: AI overly affirms users asking for personal advice

#489

Earlier quoted context omitted.

> relationships that don't lead anywhere Relationships are not transactions that are supposed to "lead somewhere".

You’re being a bit pedantic here “leading somewhere” is accepted shorthand for a lasting, satisfying relationship that is good for both parties.

Relationships aren't transactional. This isn't a business deal.

Re: AI overly affirms users asking for personal advice

#490

Earlier quoted context omitted.

Oh man, I have 8 reddit accounts (AFAIK) one for each purpose so that I am not branded based on my open comments. Anyways, one of them is abandoned because ... that's where I got started at reddit about 7-10 years back. Got hooked actually to the relationship subs. Very addictive to start with. Then I tried to play the "Indian family values" where I would advocate communication and compromise for small matters, of co…

That's amazing you have more than one account, aren't a power mod, and haven't been IP banned yet.

Having more than one account isn't against Reddit's ToS.

If you use your different accounts in different subreddits and never have your accounts interact, you won't be banned.

Post reply on HN