Microsoft's AI shopping announcement contains hallucinations in the demo
1–10 of 108 posts
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#2Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#3Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
In classification problems there’s a useful term for something similar already — False Positives…
false positive (FP), Type I error
A test result which wrongly indicates that a particular condition or attribute is present
Edit — Though I’m not sure how well that fits for a LLM (it’s more a series of false positives at each step of prediction in the sequence).
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#4Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
To be fair, if we are going to anthropomorphize it, bullshit and lies implies some sort of negative intent that I’m not sure the models have.
Bullshit is probably the closest, as people will bullshit for all sorts of reasons, but hallucinations is at least intent-neutral, which I think is the point.
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#5Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
Bullshitting and lies is what the humans selling the AI-powered services are doing. Hallucination, delusion and confabulation are what the AIs are doing (and some of the humans, too).
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#6Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
In classification problems there’s a useful term for something similar already — False Positives … false positive (FP), Type I error A test result which wrongly indicates that a particular condition or attribute is present https://en.m.wikipedia.org/wiki/Confusion_matrix Edit — Though I’m not sure how well that fits for a LLM (it’s more a series of false positives at each step of prediction in the sequence).
In psychology, we've got a term which is almost 100% matching: confabulation. The only part which isn't correct is association with brain damage.
https://en.wikipedia.org/wiki/Confabulation
In psychology, confabulation is a memory error defined as the production of fabricated, distorted, or misinterpreted memories about oneself or the world. It is generally associated with certain types of brain damage (especially aneurysm in the anterior communicating artery) or a specific subset of dementias.
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#7Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
Then tell us what we should call these manifestations...
It's say to say stop calling it X, but then what are we supposed to call them?
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#8Earlier quoted context omitted.
In classification problems there’s a useful term for something similar already — False Positives … false positive (FP), Type I error A test result which wrongly indicates that a particular condition or attribute is present https://en.m.wikipedia.org/wiki/Confusion_matrix Edit — Though I’m not sure how well that fits for a LLM (it’s more a series of false positives at each step of prediction in the sequence).
In psychology, we've got a term which is almost 100% matching: confabulation. The only part which isn't correct is association with brain damage. https://en.wikipedia.org/wiki/Confabulation In psychology, confabulation is a memory error defined as the production of fabricated, distorted, or misinterpreted memories about oneself or the world. It is generally associated with certain types of brain damage (especially an…
I think it's a good term for this but it also side steps the issue that this isn't a actually intelligence coming up with it. It's just machine noise
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#9Stop calling them hallucinations. If we're going to anthropomorphize AIs, let's just call it bullshitting and lies. If we're not going to anthropomorphize AIs, then we need a different term
It’s the adopted term. I don’t see why it HAS to be the absolute exact closest possible term to what it would be in a human or something.
It feels a bit like saying “stop calling it e-mail! It’s got nothing to do with real mail!”
Re: Microsoft's AI shopping announcement contains hallucinations in the demo
#10A hallucination is an unexpected emergence.
The 'making up' facts, because it cannot determine a fact from fiction, is entirely expected behavior.
There is no 'hallucination' as the behavior is anticipated, expected, and entirely within normal operations processes.
The bullshit comes from there being no model of trust these AIs subscribe to. I'd love-love-love to see these AI producers be held to some responsibility to verification of truth and ethics.
These companies/universities/groups allowing their applications to bold-face-lie (misrepresent data with authority) to citizens should be top-priority to bash-in-the-face by legislators around the world.