This is where I asked GPT 5.5
"they say u hallucinate 3x more than GLM 5.2, whats your comeback to this? do i need to dump u? $article"
GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
31–40 of 318 posts
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#32> For the non technical, this is like asking a delivery driver to drop off packages at 3 houses at the same time without ever stopping the truck. I'm already hallucinating about how this could work and it involves catapults
Or we could simply hallucinate that the packages are there at the three houses. Hallucinations all the way down...
In the end it's just Boltzmann brains.
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#33I think hallucination rates are not a matter of model size but depends on the training of the model. They have been trained on a huge corpus of material that had overwhelmingly well formed questions and we'll formulated and correct answers. This is typically the case of books where the material is highly curated by experts in the field. In a book you never see a question which admit no answer and the book just reason…
Skinner would say it is not so much about emotions like fear or greed, but about consequences.
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#34I think hallucination rates are not a matter of model size but depends on the training of the model. They have been trained on a huge corpus of material that had overwhelmingly well formed questions and we'll formulated and correct answers. This is typically the case of books where the material is highly curated by experts in the field. In a book you never see a question which admit no answer and the book just reason…
[flagged]
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#35My anecdotal experience differs (though I hold ground that LLM evaluations are highly subjective and benchmarks are just as useful for LLMs as they are for dating websites users).
GLM 5.2 tends to stray way more than and 5.1. It also hallucinates you things subtly: morphs requirements, makes unfounded conclusions. This output is not something I experienced in any model I seen so far.
In coding it's especially annoying because it steers whole request. E.g. I give instruction: "make we a Rust-WASM-Canvas app" and GLM 5.2 goes like "Oh user surely doesn't mean that. I'll better build Dioxus app instead".
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#36My anecdotal experience differs (though I hold ground that LLM evaluations are highly subjective and benchmarks are just as useful for LLMs as they are for dating websites users). GLM 5.2 tends to stray way more than and 5.1. It also hallucinates you things subtly: morphs requirements, makes unfounded conclusions. This output is not something I experienced in any model I seen so far. In coding it's especially annoyin…
Yeah the benchmark for sure isn't perfect and without super rigid prompting it is far too easy for it to get off course. 28% hallucination rate isn't nothing either
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#37Why is everyone expecting LLMs to be like the Star Trek computer? I wonder if anyone's ever measured what the hallucination rate of a human is.
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#38I think hallucination rates are not a matter of model size but depends on the training of the model. They have been trained on a huge corpus of material that had overwhelmingly well formed questions and we'll formulated and correct answers. This is typically the case of books where the material is highly curated by experts in the field. In a book you never see a question which admit no answer and the book just reason…
Skinner would say it is not so much about emotions like fear or greed, but about consequences.
Yes, that's when we are mindful and we see the arise in our mind but we don't directly act out of it but we understand it and reason about our options and the consequences.
However the fear has to arise in the first place, to raise the alert.
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#39Earlier quoted context omitted.
> Hallucination rate scores are a little tricky to interpret because they're conditional on the model not knowing the answer. That means they don't measure the probability of your encountering a hallucination in everyday use, since that also depends on the probability of the model not knowing the answer, as well as how well your distribution of tasks aligns with the distribution tested in the eval. Do you have a cite…
Since models just output the the most probable tokens and you can never accuse them of doing anything other than making it all up, I would like to see these tests run with a prompt that attempts to mitigate hallucination and finishes with something like: "Telling me that you don't have the relevant information or that the task is impossible is extremely useful to me and a valid answer", and see how much that changes…
[dead]
Re: GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
#40[flagged]