Earlier quoted context omitted.
Am I the only one who is bothered by calling this phenomenon "hallucinating"? It's marketing-speak and corporate buzzwords to cover for the fact that their LLMs often produced wrong information because they aren't capable of understanding your request, nuance, or the training data it used is wrong, or the model just plain sucks. Would we tolerate such doublespeak it were anything else? "Well, you ordered a side of fr…
Nonsense. It isn't marketing speak to cover for anything. It's a pretty good description of what is happening. The reason models hallucinate is because we train them to produce linguistically plausible output, which usually overlaps well with factually correct output (because it wouldn't be plausible to say e.g. "Barack Obama is white"). But when there isn't much data to show that something that is totally made up is…
it translates to "Creates text which contains incorrect or invalid information"
The latter just doesn't sound as good in headlines/articles/tutorials (eg. marketing material).