Live data from Hacker News

Over fifty new hallucinations in ICLR 2026 submissions

gptzero.me

11–20 of 442 posts

Re: Over fifty new hallucinations in ICLR 2026 submissions

#11
post #4

Can we just call them "lies" and "fabrications" which is what they are? If I write the same, you will call them "made up citations" and "academic dishonesty". One can use AI to help them write without going all the way to having it generate facts and citations.

[dead]

Re: Over fifty new hallucinations in ICLR 2026 submissions

#12
post #10

It's going to be even worse than 50: > Given that we've only scanned 300 out of 20,000 submissions, we estimate that we will find 100s of hallucinated papers in the coming days.

20,000 submissions to a single conference? That is nuts

This is an interesting article along those lines...

https://www.theguardian.com/technology/2025/dec/06/ai-resear...

Re: Over fifty new hallucinations in ICLR 2026 submissions

#15
post #10

It's going to be even worse than 50: > Given that we've only scanned 300 out of 20,000 submissions, we estimate that we will find 100s of hallucinated papers in the coming days.

20,000 submissions to a single conference? That is nuts

Doesn't seem especially out of the norm for a large conference. Call it 10,000 attendees which is large but not huge. Sure; not everyone attending puts in a session proposal. But others put multiple. And many submit but, if not accepted don't attend.

Can't quote exact numbers but when I was on the conference committee for a maybe high four figures attendance conference, we certainly had many thousands of submissions.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#16
If a carpenter builds a crappy shelf “because” his power tools are not calibrated correctly - that’s a crappy carpenter, not a crappy tool.

If a scientist uses an LLM to write a paper with fabricated citations - that’s a crappy scientist.

AI is not the problem, laziness and negligence is. There needs to be serious social consequences to this kind of thing, otherwise we are tacitly endorsing it.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#17

Is the baseline assumption of this work that an erroneous citation is LLM hallucinated? Did they run the checker across a body of papers before LLMs were available and verify that there were no citations in peer reviewed papers that got authors or titles wrong?

Yeah that is what their tool does.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#19

Is the baseline assumption of this work that an erroneous citation is LLM hallucinated? Did they run the checker across a body of papers before LLMs were available and verify that there were no citations in peer reviewed papers that got authors or titles wrong?

People will commonly hold LLMs as unusable because they make mistakes. So do people. Books have errors. Papers have errors. People have flawed knowledge, often degraded through a conceptual game of telephone.

Exactly as you said, do precisely this to pre-LLM works. There will be an enormous number of errors with utter certainty.

People keep imperfect notes. People are lazy. People sometimes even fabricate. None of this needed LLMs to happen.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#20

Is the baseline assumption of this work that an erroneous citation is LLM hallucinated? Did they run the checker across a body of papers before LLMs were available and verify that there were no citations in peer reviewed papers that got authors or titles wrong?

They explain in the article what they consider a proper citation, an erroneous one and an hallucination, in the section "Defining Hallucitations". They also say than they have many false positives, mostly real papers who are not available online.

Thad said, i am also very curious of the result than their tool, would give to papers from the 2010's and before.

Post reply on HN