Live data from Hacker News

AI overly affirms users asking for personal advice

news.stanford.edu

521–530 of 684 posts

Re: AI overly affirms users asking for personal advice

#521

Earlier quoted context omitted.

I find Kimi white good if you ask it for critical feedback. It’s BRUTAL but offers solutions.

what is Kimi white?

I was typing quickly on my phone. I meant “quite”, “I find Kimi quite good”

Re: AI overly affirms users asking for personal advice

#523

Earlier quoted context omitted.

Yeah, I think Claude is a lot more logical in that sense, I use it for some therapy sessions myself and it pushes back a bit more than Open AI and Gemini

Don’t call them therapy sessions. They kind of look like it but ultimately these are smoke blowing machines, which is very far from what a therapist would do.

People generalize "therapy" all the time.

I [half] jokingly tell people that a nice drive in a 911 [can be] better/cheaper therapy that going to a PhD.

Re: AI overly affirms users asking for personal advice

#524
post #220

Earlier quoted context omitted.

The same way you distinguish between feeling like having a problem and actually having a problem.

This is needlessly flippant and not really the same thing. Determining progress in a therapy setting is usually a collaborative effort between the therapist and the client. An LLM is not a reliable agent to make that determination.

The thing they have in common is that they will both go forever....

Meaning neither the LLM or the licensed therapist will voluntarily say, you are healed, you don't need me anymore.

Re: AI overly affirms users asking for personal advice

#526
post #183

> They also included 2,000 prompts based on posts from the Reddit community r/AmITheAsshole, where the consensus of Redditors was that the poster was indeed in the wrong. Sorry, anonymous people on reddit aren't a good comparison. This needs to be studied against people in real life who have a social contract of some sort, because that's what the LLM is imitating, and that's who most people would go to otherwise. Obv…

Reddit is notorious for being awful at real life interactions just look at the relationship subreddit the first answer is always divorce, it’s become a meme but beyond romantic relationships, i think a lot of us have seen how it can impact work relationships, i’ve had venture partners clearly rely on AI (robotic email responses and even SMS) and that warped their perception and made it harder to connect. It signals l…

One of the reasons relationship advice subreddits suggest divorce so often is because most people with "small" problems in their relationships don't write an essay about it on Reddit but are able to solve them with the tools/friends they have. So a Reddit post existing indicates the relationship has serious flaws.

This is not to defend the study, because asking AI has a lower barrier to entry.

Re: AI overly affirms users asking for personal advice

#527

Earlier quoted context omitted.

> e.g. If the OP is asking "I ghosted my friend in AA who insulted me during a relapse", Reddit would say NTA in a heartbeat, while the real world would tell OP to be more forgiving. That’s a nuanced discussion. It depends on what you value most, not what “real world” tells you. Most of the time Reddit would be right, because you need to prioritize yourself instead of continuing toxic relationships.

1) Reddit is horrible at nuance, almost non existent in some subs. 2) The toxicity is being defined by reddit to give the advice which is mostly wrong as outlined above. If OPs had a understanding of what they valued and what is toxic, they probably wouldn't need a advice from biased readers [biased in the sense that they're on that sub].

That’s true, but they still might be right for wrong reasons.

Re: AI overly affirms users asking for personal advice

#528

Earlier quoted context omitted.

Except it’s not toxic to suggest that cutting toxic relationship out yields greater happiness.

Well, maybe. The challenge is interpreting what is toxic, correctly. Also, if everyone I know is “toxic” then that’s a good sign that the problem is me and not everyone else.

> The challenge is interpreting what is toxic, correctly.

Correct. It is always case by case review.

> Also, if everyone I know is “toxic” then that’s a good sign that the problem is me and not everyone else.

Why “everyone”? Generalizations like these are the same mistake that Reddit, that you’re calling out, makes.

Also, toxic is relative to your perspective – it’s not a universal merit.

Re: AI overly affirms users asking for personal advice

#529

A pastime I have with papers like this is to look for the part in the paper where they say which models they tested. Very often, you find either A) it's a model from one or more years ago, only just being published now, or B) they don't even say which model they are using. Best I could find in this paper: > We evaluated 11 user-facing production LLMs: four proprietary models from OpenAI, Anthropic, and Google; and se…

> A pastime I have with papers like this is to look for the part in the paper where they say which models they tested.

My pastime (not really) in HN submissions like this is to look for the comment where someone complains about the models used because they aren’t the literal same model and version the commenter has started using the day before.

It’s always “you can’t test with those models, those are crap, the ones we have now are much better”, in perpetuity. It’s Schrödinger’s LLM: simultaneously god-like and a piece of garbage depending on the needs of the discussion. It’s beyond moving the goalposts, it’s moving the entire football field. It’s a clear bad faith attempt to try to discredit any study the commenter doesn’t like. Which you can always do because you can’t test literally everything.

Re: AI overly affirms users asking for personal advice

#530

Earlier quoted context omitted.

That's amazing you have more than one account, aren't a power mod, and haven't been IP banned yet.

You can't use IP address to ban someone without significant abuse. All home network routers put everyone in the house behind the same IP address. For all reddit knows, there are 8 people in the house using reddit.

Want a new IP address? Reset your router or cycle it. Typically it'll procure a new IP address from the ISP.

I guess that makes IP banning residential nodes even more stupid.

Post reply on HN