[dead]
AI overly affirms users asking for personal advice
681–684 of 684 posts
Re: AI overly affirms users asking for personal advice
#682Earlier quoted context omitted.
Thank you. Yes, I'm going to refrain from airing out my dirty laundry. I made a bad decision, now I'm living with it, and more context doesn't actually change the intent behind my message: these tools are dangerous. Getting better, but still dangerous.
> Yes, I’m going to refrain from airing out my dirty laundry. I made a bad decision, now I’m living with it, and more context doesn’t actually change the intent behind my message That’s not entirely true, as it’s currently impossible to actually gauge the severity of what the LLM seemingly enabled you into doing. There’s a difference between “I uncritically accepted everything it told me because it lined up with what…
Exactly all of this - I didn't have my popcorn out, I was genuinely curious about the nature of the risk being discussed. I find the post basically worthless without context - a wood stove is dangerous if you place your hand on top of it while its hot, but not in the same way a grenade is dangerous if you accidentally remove the pin without understanding the consequences..
Re: AI overly affirms users asking for personal advice
#683Even as someone who (wrongly) believed that I had high emotional intelligence, I too was bit by this. Almost a year ago when LLMs were starting to become more ubiquitous and powerful I discussed a big life/professional decision with an LLM over the course of many months. I took its recommendation. Ultimately it turned out to be the wrong decision. Thankfully it was recoverable, but it really sobered me up on LLMs. Th…
I also used it for advice on a massive personal decision, but I specifically asked it to debate with me and persuade me of the other side. I specifically prompted it for things I am not thinking about, or ways I could be wrong. It was extremely good at the other side too. You just have to ask. I can imagine most people don't try this, but LLMs literally just do what you ask them to. And they're extremely good and wei…
This has also been my experience - asking it to take the devil's advocate of the other side of the coin and assume the persona of 'X relevant highly rational type with deep knowledge in the field' both have a lot of utility. You can do this in more than one dimension, too.
Re: AI overly affirms users asking for personal advice
#684[dead]