We need to tell people ChatGPT will lie to them, not debate linguistics
1–10 of 485 posts
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#2Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think.
If we're going to anthropomorphize, then let us anthropomorphize wisely. ChatGPT is, presently, like having an assistant who is patient, incredibly well-read, sycophantic, impressionable, amoral, psychopathic, and prone to bouts of delusional confidence and confabulation. The precautions we would take engaging with that kind of person, are actually rather useful defenses against dangerous AI outputs.
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#3Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think. If we're going to anthropomorphize, then let us anthropomorphize wi…
do you have a link for any of those reports? would be interesting to read to say the least.
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#4Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think. If we're going to anthropomorphize, then let us anthropomorphize wi…
I love this description. The only thing left is to generate the corresponding avatar with dall-E
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#5Related ongoing thread:
Why ChatGPT and Bing Chat are so good at making things up - https://news.ycombinator.com/item?id=35479071
The other related article was discussed here:
Eight things to know about large language models [pdf] - https://news.ycombinator.com/item?id=35434679 - April 2023 (108 comments)
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#6Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think. If we're going to anthropomorphize, then let us anthropomorphize wi…
I like Steve Yegge's "grad student experiencing the residual effects of shrooms" (lightly paraphrased).
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#7Agreed. People lie to me all of the time. Heck, half the time my anecdotal stories are probably riddled with confident inaccuracies. We are socially trained to take information from people critically and weight it based on all kinds of factors.
We should treat Chat GPT the exact same way.
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#8Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think. If we're going to anthropomorphize, then let us anthropomorphize wi…
Anybody know what are ChatGPT's pronouns?
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#9Indeed. We are anthropomorphizing them. I do it all the time and I should know better. There are already a few reports floating around of people who have seemingly been driven mad, come to believe strongly that the language model they're using is a conversation with a real person. A lot of people will really struggle with this going forward, I think. If we're going to anthropomorphize, then let us anthropomorphize wi…
Anybody know what are ChatGPT's pronouns?
shog/goth
Re: We need to tell people ChatGPT will lie to them, not debate linguistics
#10Someone in my company spent the past month setting up ChatGPT to work with our company's knowledge base. Not by a plugin or anything, just by telling ChatGPT where to find it. They didn't believe that ChatGPT was making any of it up, just that sometimes it got it wrong. I stopped arguing after a while.