Why AI is failing at giving good advice
maximzubarev.com
Why AI is failing at giving good advice
1–10 of 42 posts
Re: Why AI is failing at giving good advice
#2_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.
Re: Why AI is failing at giving good advice
#3_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.
Isnt that an extension of the same problem though? You probe it to take the statistically most accepted alternative perspectives that exists in its data. Its not intelligent in the sense that it comprehends what you or it are saying, it just follows the weights.
Re: Why AI is failing at giving good advice
#4If you ask generic questions, it will give generic answers. The key is to include lots of relevant information and context in your questions. Yes a person might be able to provide more specific advice relating to your situation, but a lot of that is just that they have more context about what you're asking
Re: Why AI is failing at giving good advice
#5_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.
Isnt that an extension of the same problem though? You probe it to take the statistically most accepted alternative perspectives that exists in its data. Its not intelligent in the sense that it comprehends what you or it are saying, it just follows the weights.
It definitely doesn't just "follow the weights". It can follow instructions that go down paths where there would be no similar training data and no simple completion that could result in that response.
What it does probably isn't "comprehension", but we also have no idea what comprehension is so it's not a very good target.
Re: Why AI is failing at giving good advice
#6_By default_ GPT gives the average advice. You can prompt it to take perspectives that will lead it to give very different advice.
I find it follows wherever you lead it, but if I know what kind of advice I need, what information is the bot adding?
Re: Why AI is failing at giving good advice
#7[dead]
Re: Why AI is failing at giving good advice
#8The problem is trust. I don't trust GPT.
Re: Why AI is failing at giving good advice
#9Asking ChatGPT for advice is like asking a genius trickster for advice. There is a chance what they say is 100% true, but the chance that the trickster confidently tells you something entirely made up is definitely there.
And that is the main issue. I can trust some friend or co-worker to tell me when they don't know, because they like me and they have no incentive to tell me bullshit — yeah they might look better if they did, but if there is any doubt on my side it just makes them look bad and that this happens sooner or later is nearly certain.
ChatGPT has no concept of this, so it will happily just give you something plausible but wrong.
Re: Why AI is failing at giving good advice
#10That's why I ask my favorite AI for advice, then paste it in my second favorite AI and ask it if it agrees and so on to the third and fourth until I'm satisfied. If I really want to make sure I then Google it. This all depends on how important it is I get the right answer.