Am I wrong or LLMs are text not fact generators ?
"We" ask them to generate text that includes the facts.
ChatGPT provides false information about people, and OpenAI can't correct it
21–30 of 92 posts
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#22People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
I don't know, it seems recently that we've detached what things are from what the people behind them say things are, so bing AI is an LLM, phind is an LLM, and they market themselves as search engine, like to see in details you say >> It is not a mechanism to retrieve facts Then bing AI powered by chatgpt shows on its site >> [Hello, this is Bing! I’m the new AI-powered chat mode of Microsoft Bing that] can help you…
Bing is not just an LLM. It’s RAG, the LLM is just a layer on top of a typical search engine. The LLM is not “getting” any facts, it’s just synthesizing them in a human-readable format.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#23People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
[dead]
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#24You can make LLMs say pretty much whatever you want with the right prompts. This is a complex issue, and if EU citizens want access to LLMs the GDPR is going to need a different set of rules for LLMs than for websites and search engines.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#25People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
OpenAI openly and knowingly, and Microsoft even more, presents ChatGPT as a way to get facts.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#26Every single time... https://hachyderm.io/@inthehands/112006855076082650 > You might be surprised to learn that I actually think LLMs have the potential to be not only fun but genuinely useful. “Show me some bullshit that would be typical in this context” can be a genuinely helpful question to have answered, in code and in natural language — for brainstorming, for seeing common conventions in an unfamiliar context, f…
Nobody put what I think about AI better than this.
Yes, there are good cases where "realistically sounding bullshit" is useful! I remember in the early days, before everyone grew kind of tired (well, at least me) of GPT, people used "hehe write me PC manual in style of slam poetry" or whatever, and that is fun.
However, people use it to get facts!
Just a few days ago, I have read somewhere that hospitals are planning to use LLMs to replace nurses. That is horrifying. Absolutely horrifying.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#27People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
OpenAI openly and knowingly, and Microsoft even more, presents ChatGPT as a way to get facts .
Now what I think would be interesting if one can use ChatGPT or whatever to distill any kind of document into a series of factoids. Say you give it the Wikipedia article about a famous person and it will extract stuff like "born: 1949-01-30" and associate it with the name of the person.
Later on, a user asks an AI "when was Foo Bar born?", and the AI then looks up the factoid database and responds with the correct factoid, or an error message.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#28People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
> So what would they correct? The best that can be done is like it is said in the article, apply filtering to refuse to answer.
Stop providing service in the region in which your product is unable to comply with local regulations?
You can't extract millions of euros from EU citizens with anything physical that goes against the EU law, but we like to pretend that because something's digital, it's totally fine if your product intentionally breaks the law, even if it's just for a couple of years until some random NGO sues you and courts react. I think that's nonsense.
I'm not gonna say the EU needs its own equivalent of the Great Firewall, but there should be some cost of being intentionally non-compliant, as in fines, as in the same thing the EU already does to Facebooks and TikToks of the world.
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#29People have a fundamental misunderstanding of what LLMs are. I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts. It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts. The article talks about OpenAI being unwilling to correct errors. But they just can’t. There…
>People have a fundamental misunderstanding of what LLMs are. It's labeled "AI", aka "artificial intelligence". So clearly, it's intelligent enough to tell fact from fiction, right? It's intelligent enough to read and repeat facts, right? It's artificial intelligence , isn't it? I'm playing Devil's Advocate here, obviously. I'm aware how this actually works like you, but the way it's billed you can't expect the commo…
Even real intelligence struggles to tell facts from fiction, otherwise the world would look very different. That's yet another problem with AI, people often aren't sure what they can expect but many err on the side of "magical oracle".
Re: ChatGPT provides false information about people, and OpenAI can't correct it
#30That's because it's being used in the wrong way. It isn't a factual database.
AI pushers are presenting them as factual databases. REpeatedly.