Live data from Hacker News

ChatGPT provides false information about people, and OpenAI can't correct it

noyb.eu

91–92 of 92 posts

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#91
post #32

I wonder if my insight on these is wrong, but from what I understand, the GPTs and such are basically all hallucinations, and it's just that most of these are also correlated to reality, what actually exists.

You just described the human mind. What we see in our heads is wholly imagined, mostly correlated to reality. You see things clearly, without the huge empty spot in the middle or fuzzy black-and-white periphery. And usually without hallucinations, where our predictive minds miscalculates and adds in things to our imagined interior world that don't exist in reality.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#92
post #32

I wonder if my insight on these is wrong, but from what I understand, the GPTs and such are basically all hallucinations, and it's just that most of these are also correlated to reality, what actually exists.

I find that explaining errors and factual mistakes in LLMs or AI in general as hallucinations to be counter-productive. I don't know if the field has landed on a specific definition of what hallucination is, but I mostly associate it with garbled output from tokens like 'SolidGoldMagicKarp'[0] and 'davidjl'[1].

My understanding is that AI models like GPT have been able to convincingly convey the form of language, but not its meaning. It looks and sounds like how a human would communicate, but the AI is unable to imbue meaning into the words and sentences it produces. My knowledge of this comes from Lex Friedman's episode with Edward Gibson [2].

I think that's the fundamental issue with LLMs at the moment. It has managed to mostly exit the uncanny valley because, as far as most people are concerned, the text produced could just as well have been made by a human. I think this lends some credibility to the text produced by the LLM, because more or less all text ever produced has had a human behind it. This is no longer the case and as such there is bound to be a transitional period where we learn how to deal with this new technology.

[0]: https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldm...

[1]: https://twitter.com/goodside/status/1666598580319035392

[2]: https://youtube.com/watch?v=F3Jd9GI6XqE&t=230

Post reply on HN