Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT provides false information about people, and OpenAI can't correct it

noyb.eu

Post reply on HN
Print view View original

41–50 of 92 posts

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#41

Post by dguest »

chx wrote: post #7

Every single time... https://hachyderm.io/@inthehands/112006855076082650 > You might be surprised to learn that I actually think LLMs have the potential to be not only fun but genuinely useful. “Show me some bullshit that would be typical in this context” can be a genuinely helpful question to have answered, in code and in natural language — for brainstorming, for seeing common conventions in an unfamiliar context, f…

We all knew a guy who would never stop talking. Maybe in college.

Some people thought he must be very smart, and would listen to that guy for hours on end. Most people eventually got annoyed / board and left. But he kept going. The thing was, he knew a lot of stuff. But of course, an audience is a hell of a drug, he had to keep going, and some of the stuff he said ended up being bullshit.

Now LLMs are that guy. We have automated "Cory from the 3rd floor, after a few beers". You wouldn't cite Cory from the 3rd floor on your term paper, why would you cite an LLM?

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#42

Post by mrtksn »

Mordisquitos wrote: post #35
mrtksn wrote: post #4

IMHO this is not a fixable problem, it's not even a new problem because false information existed since ever. With the Web it become globally available, with social media it become globally spreadable and with "AI" it has become of endless supply in form and variety. Humans need to develop humane defense mechanisms for the new reality, tech cannot be stopped and cannot be hermetically insulated against mistakes or ba…

Why is it "not a fixable problem"? So many problems introduced by new technologies have been claimed to be "non fixable" by the businesses promoting them until, lo and behold, the law has forced them to do so.

Was lying online fixed? The attempts to fix it come at great costs, which is usually suppression of speech which leads to all kind of problems associated with lack of information or feeding faulty information.

Attempts fixing hate speech on social media resulted in similar situation, now hate becoming mainstream. American social media banned keywords for racism or hate speech, only to push them to dog whistle racism and hate speech.

The problem about fixing lie is that its impossible to objectively decide what is a lie and this is true for all kind of stuff about people.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#43

Post by oguz3 »

ChatGPT is not a magical database that provides correct answers to all questions. It is an LLM that draws conclusions and propositions from the context you offer. Instead of just asking a question and waiting for an answer, you can provide detailed context and engage in a discussion about it.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#44

Post by karencarits »

mschuster91 wrote: post #27
trustno2 wrote: post #25

Earlier quoted context omitted.

OpenAI openly and knowingly, and Microsoft even more, presents ChatGPT as a way to get facts .

Now what I think would be interesting if one can use ChatGPT or whatever to distill any kind of document into a series of factoids. Say you give it the Wikipedia article about a famous person and it will extract stuff like "born: 1949-01-30" and associate it with the name of the person. Later on, a user asks an AI "when was Foo Bar born?", and the AI then looks up the factoid database and responds with the correct fa…

Note that a lot of the information on Wikipedia is available as a structured knowledge graph already: https://wikidata.org/wiki/Wikidata:Main_Page

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#45

Post by Mordisquitos »

mrtksn wrote: post #42
Mordisquitos wrote: post #35

Earlier quoted context omitted.

Why is it "not a fixable problem"? So many problems introduced by new technologies have been claimed to be "non fixable" by the businesses promoting them until, lo and behold, the law has forced them to do so.

Was lying online fixed? The attempts to fix it come at great costs, which is usually suppression of speech which leads to all kind of problems associated with lack of information or feeding faulty information. Attempts fixing hate speech on social media resulted in similar situation, now hate becoming mainstream. American social media banned keywords for racism or hate speech, only to push them to dog whistle racism…

Yes, it was.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#46

Post by andersa »

brianjacobss wrote: post #15
mrtksn wrote: post #4

IMHO this is not a fixable problem, it's not even a new problem because false information existed since ever. With the Web it become globally available, with social media it become globally spreadable and with "AI" it has become of endless supply in form and variety. Humans need to develop humane defense mechanisms for the new reality, tech cannot be stopped and cannot be hermetically insulated against mistakes or ba…

You're totally right.We can't just hit the brakes on technology. It's here to stay, with its flaws and perks. As users, we need to be savvy about what we see online, questioning stuff instead of just swallowing it whole. Education is key here. The more we can help people navigate digital sources of information, the better equipped they'll be to identify misinformation.

Why do all of your comments look like ChatGPT wrote them?

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#47

Post by [deleted] »

LASR wrote: post #10

People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…

[deleted]

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#48

Post by imiric »

yunwal wrote: post #22
lnxg33k1 wrote: post #17

Earlier quoted context omitted.

I don't know, it seems recently that we've detached what things are from what the people behind them say things are, so bing AI is an LLM, phind is an LLM, and they market themselves as search engine, like to see in details you say >> It is not a mechanism to retrieve facts Then bing AI powered by chatgpt shows on its site >> [Hello, this is Bing! I’m the new AI-powered chat mode of Microsoft Bing that] can help you…

Bing is not just an LLM. It’s RAG, the LLM is just a layer on top of a typical search engine. The LLM is not “getting” any facts, it’s just synthesizing them in a human-readable format.

How is LLM+RAG any different from a fine-tuned LLM without RAG? They're both trained on data, and have the capability to hallucinate.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#49

Post by iLoveOncall »

LASR wrote: post #10

People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…

> The article talks about OpenAI being unwilling to correct errors. But they just can’t.

You surely understand how this isn't a compelling argument at all, right?

If you have a bug in your X-Ray software and it irradiates patients but you say you don't have the knowledge or resources to fix it, it doesn't suddenly become a way out of fixing it.

This will be a slam dunk of a case. There are many obvious paths that OpenAI can follow, such as stopping business in the EU or preventing it from giving any fact about any person.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#50

Post by mrtksn »

Mordisquitos wrote: post #45
mrtksn wrote: post #42

Earlier quoted context omitted.

Was lying online fixed? The attempts to fix it come at great costs, which is usually suppression of speech which leads to all kind of problems associated with lack of information or feeding faulty information. Attempts fixing hate speech on social media resulted in similar situation, now hate becoming mainstream. American social media banned keywords for racism or hate speech, only to push them to dog whistle racism…

Yes, it was.

See, one lie just sneaked in.
Post reply on HN