Live data from Hacker News

Why AI is failing at giving good advice

maximzubarev.com

11–20 of 42 posts

Re: Why AI is failing at giving good advice

#11

That's why I ask my favorite AI for advice, then paste it in my second favorite AI and ask it if it agrees and so on to the third and fourth until I'm satisfied. If I really want to make sure I then Google it. This all depends on how important it is I get the right answer.

Sounds like super cumbersome and tedious way to get answers, can't remember the last problem I had that would justify such effort.

Re: Why AI is failing at giving good advice

#12

_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.

I find it follows wherever you lead it, but if I know what kind of advice I need, what information is the bot adding?

At the end of the day, the advice seeker is responsible for the evaluation of given advice for their situation.

That's a key difference between advice and instruction.

The advice giver cannot know the seeker's situation completely, nor can the advice seeker know the giver's.

An AI cannot be trusted to give The Answer. But you can use AI to explore other perspectives and critique your thoughts—not that its critiques will be correct either. Nonetheless it can help get you on different thinking paths that your normal thought patterns wouldn't guide you on.

Re: Why AI is failing at giving good advice

#13
Everyone's talking about GPT and I'm sitting here, alone, with my Gemini (Advanced). I find it much more "human" like, but maybe that's just my preference for its style of writing - my brain simply finds it easier to process its responses and they're much more human-like.

Recently I have used it for some psychotherapy. I didn't expect much, but it actually provided me with some really useful exercises, tips, explanations and it helped me immensely. I would probably spend at least few hundred, if not thousand, buck on a "normal" therapy that would give me comparable results (anectodal of course, and I'm a weird guy overall).

The trick was to start with "I know you're not a therapist but I'm waiting for an appointment and I would appreciate your help".

I'm not promoting as something better than "normal" therapy for most people, but for me it was incredibly helpful and helped me at least minimize my anxiety attacks. I've used GPT previously for the same thing, and its answers were barely useful.

Re: Why AI is failing at giving good advice

#14

Everyone's talking about GPT and I'm sitting here, alone, with my Gemini (Advanced). I find it much more "human" like, but maybe that's just my preference for its style of writing - my brain simply finds it easier to process its responses and they're much more human-like. Recently I have used it for some psychotherapy. I didn't expect much, but it actually provided me with some really useful exercises, tips, explanat…

Woebot is a chatbot used by mental health therapists to help clients out of session. Reading through comments on facebook, people like it.

Re: Why AI is failing at giving good advice

#16
The true reason is that advice in the real-world is more than just words: truly good advice can only be rooted in the care and experience of another human being. And it's not just the care that the other person has for you, but the understanding that the advice has come from a place of experience of human suffering.

In terms of more technical questions like the one in the article, that's rather obvious too: ChatGPT is like the person giving advice about the stock market. It only speaks of averages that are already in the direction of the general movement of the masses. Truly good advice or ideas involves going against that momentum to find a new way.

Of course, AI will be helpful to some in some situations. But even that has larger societal implications: all the help it provides displaces the need for real human beings, and thus propels society into having even more problems, and thus it reduces a few current problems in exchange for more problems in the future.

AI does no ultimate good. It should be destroyed.

Re: Why AI is failing at giving good advice

#17
post #9

Asking ChatGPT for advice is like asking a genius trickster for advice. There is a chance what they say is 100% true, but the chance that the trickster confidently tells you something entirely made up is definitely there. And that is the main issue. I can trust some friend or co-worker to tell me when they don't know, because they like me and they have no incentive to tell me bullshit — yeah they might look better if…

However—some defenders will say—your friend or co-worker may think they know the answer but be wrong and still give you the wrong information confidently.

To which I’d respond that it’s important to not ignore the continuity of life. The person giving you the information may themselves learn they were wrong and let you know later and unprompted. Or you may learn the facts and tell them, thus correcting it for everyone else they share with later. In addition, you’ll have a mental note of the friends and coworkers most suited to ask about particular subjects, maximising your changes of getting a right answer.

Re: Why AI is failing at giving good advice

#18

That's why I ask my favorite AI for advice, then paste it in my second favorite AI and ask it if it agrees and so on to the third and fourth until I'm satisfied. If I really want to make sure I then Google it. This all depends on how important it is I get the right answer.

Sounds like you’d save a lot of time (and electricity) by just Googling in the first place.

Re: Why AI is failing at giving good advice

#19

_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.

I find it follows wherever you lead it, but if I know what kind of advice I need, what information is the bot adding?

For me it's a form of rubber-duck debugging.

I've never managed to make it work with an actual rubber duck. Talking to an inanimate object doesn't make me think any differently, but there's something in trying to formulate things to get the LLM to "understand" my problem that triggers the same brain mechanisms I get when explaining it to a real person.

Re: Why AI is failing at giving good advice

#20
post #11

That's why I ask my favorite AI for advice, then paste it in my second favorite AI and ask it if it agrees and so on to the third and fourth until I'm satisfied. If I really want to make sure I then Google it. This all depends on how important it is I get the right answer.

Sounds like super cumbersome and tedious way to get answers, can't remember the last problem I had that would justify such effort.

You're right. I thought about it and I'm more trying to see how they work and what are their differences. It's surprising sometimes. They each have their strengths. For example, if you like reddit answers Meta AI seems to best at that.
Post reply on HN