[deleted]
ChatGPT produces made-up nonexistent references
31–40 of 162 posts
Re: ChatGPT produces made-up nonexistent references
#32I like that very much. ChatGPT always states that it has no connection to reality, since it lacks the organ of perception (Internet) and offers a pure language game. Similar to a Carl Rogers machine
Re: ChatGPT produces made-up nonexistent references
#33I tried to ask it for a list of books about the urban history with their respective authors in a Table. At first sight the result looked believable, but after looking them up, most of the books don't exist. What was especially interesting though: For one of the books that does actually exist, it completely made up the name of the author. According to it "The City: A Global History" was written by "Thomas Kaufmann", w…
Isn’t the point of these types of language models that they mostly model a language (to various degrees of correctness), rather than facts?
It is, it's what it states most of the time. It's also interesting that we believe what sounds right more than what is right.
Re: ChatGPT produces made-up nonexistent references
#34Describing GPT as a Method actor on way too many hallucinogenics strikes again
Re: ChatGPT produces made-up nonexistent references
#35Unsurprising given how it works, but the higher-level implications are somewhat unexpected. These model are extremely good when they have creative freedom and are used to produce some kind of art. Poems, text in various styles, images without important details, and so on. But they fail miserably when you give them tasks that require world knowledge or precision. For example, when I asked a programming question I got…
Art is precision.
Re: ChatGPT produces made-up nonexistent references
#36I think this is expected if you consider how ChatGPT works.
It is a language model, so its job is to generate plausible-looking text. It does not use any external reference material during inference so it has to encode all knowledge it uses in its weights. So the weights are essentially its only long-term memory.
You could say that the task it was given here was “Provide plausible-looking links without using any reference material.” For that task I think it did a reasonable job.
Re: ChatGPT produces made-up nonexistent references
#37[deleted]
Re: ChatGPT produces made-up nonexistent references
#38This is called "hallucination" and I find it to be the biggest flaw with GPT-3 interfaces like ChatGPT. Basically, the system will start convincingly BSing at any point and as a user, you're never sure if any particular detail it outputs is actually correct. The problem is, these large language models are inherently kind of a black box, so how do you fix this kind of behavior? I started looking and it turns out that…
Do you think a version tweaked for much greater incidence of "hallucination" would be a profitable sell to people who like cheap artistic text without being overly concerned about a human factor (eg: strapline writing) or too correlated with perceived low quality to sell well?
Re: ChatGPT produces made-up nonexistent references
#39This is called "hallucination" and I find it to be the biggest flaw with GPT-3 interfaces like ChatGPT. Basically, the system will start convincingly BSing at any point and as a user, you're never sure if any particular detail it outputs is actually correct. The problem is, these large language models are inherently kind of a black box, so how do you fix this kind of behavior? I started looking and it turns out that…
Right, most uses of these model I've seen, you clearly want "hallucination" or something like it: when you ask it for a poem it wouldn't be so impressive if it just spat out The Raven.
Re: ChatGPT produces made-up nonexistent references
#40This is called "hallucination" and I find it to be the biggest flaw with GPT-3 interfaces like ChatGPT. Basically, the system will start convincingly BSing at any point and as a user, you're never sure if any particular detail it outputs is actually correct. The problem is, these large language models are inherently kind of a black box, so how do you fix this kind of behavior? I started looking and it turns out that…
Do you think a version tweaked for much greater incidence of "hallucination" would be a profitable sell to people who like cheap artistic text without being overly concerned about a human factor (eg: strapline writing) or too correlated with perceived low quality to sell well?
Here lieth Lorem Ipsum, 45 BCE - 2022 CE
RIP