So they built an AI that makes things up and now you’re using it and you’re actually surprised it makes things up.
ChatGPT produces made-up nonexistent references
11–20 of 162 posts
Re: ChatGPT produces made-up nonexistent references
#12> "List Processing and Programming" by John F. Sowa (https://www.cs.cmu.edu/~fp/courses/lp/lectures.html)
The full link doesn't exist, but it's interesting that https://www.cs.cmu.edu/~fp does exist and leads to the homepage of a computer science prof at CMU (prof. Frank Pfenning, not "John F. Sowa" though). So at least it got the general vicinity right.
Re: ChatGPT produces made-up nonexistent references
#13That's the state of ML today I guess . It's only as good as what it was trained on. In my experience, if you can't find something after engaging with google's search for a couple of minutes, refining your query and going on tangents, then it probably doesn't exist, or you're asking the wrong question. I think, but I'm not sure, that in your case your question is too broad. You need to be more specific. It's as if you…
> That's the state of ML today I guess . It's only as good as what it was trained on [..]
Errm, that's not quite what this is about. Most (all?) of the training material's references are, well, real. As in, they actually exist.
Making up stuff when caught out by a line of questioning you haven't got a good factual answer for is the kind of thing my 7 year-old might do.
Re: ChatGPT produces made-up nonexistent references
#14I’ve seen gpt-3 do this in general, it’s quite interesting. It’ll quote things that sound right to the prompt and response with realistic references and names, with no actual results. These types of AI seem to be against admitting they don’t know.
Why would anyone expect a language model to admit that it "doesn't know" (unless explicitly asked to)? That's not what it's for. It's there to put together a string of words that's plausibly looking like an answer for a given prompt - that it can sometimes successfully reach for facts it was trained on while making up the answer is an added bonus, a side-effect of how it works.
Re: ChatGPT produces made-up nonexistent references
#15With all due respect, maybe RTFM before trying to do this whole “gotcha!” song and dance?
Re: ChatGPT produces made-up nonexistent references
#16I tried to ask it for a list of books about the urban history with their respective authors in a Table. At first sight the result looked believable, but after looking them up, most of the books don't exist. What was especially interesting though: For one of the books that does actually exist, it completely made up the name of the author. According to it "The City: A Global History" was written by "Thomas Kaufmann", w…
Isn’t the point of these types of language models that they mostly model a language (to various degrees of correctness), rather than facts?
Re: ChatGPT produces made-up nonexistent references
#17That is just general GPT model characteristics that they can make up look-alike BS on the fly
Copilot can make up things like imagined credentials like api key etc, then it shouldn't be a surprise it can do something like above.
Re: ChatGPT produces made-up nonexistent references
#18Yeah this isn't at all unexpected. Language models are trained to make plausible text not true text. A lot of the time it happens to produce stuff that's true, because it is more plausible that somebody say "Biden is the president" than "Steve is the president", but you asked it a pretty niche question for which there is no answer that is plausible and true so it had to go with plausible.
It clearly worked because you thought they sounded real!
Try asking it for good references that deal with lists *or "none" if there aren't any.
Re: ChatGPT produces made-up nonexistent references
#19GTP has always been the worlds best bullshit simulator. Its output is incredible until you look closely and realize that it’s not so much inaccurate, but completely hallucinated. It’s the kind of thing that would be great for filling in Lorem Ipsum placeholder text that’s just convincing enough if no one looks too close.
Re: ChatGPT produces made-up nonexistent references
#20Isn't that literally the point?