Live data from Hacker News

Over fifty new hallucinations in ICLR 2026 submissions

gptzero.me

361–370 of 442 posts

Re: Over fifty new hallucinations in ICLR 2026 submissions

#361

Earlier quoted context omitted.

You can criticize the tool or its makers, but not as a means to lessen the responsibility of the professional using it (the rest of the quoted comment). I agree with the GP, it's not a valid excuse for the scientist's poor quality of work.

I just substantially edited the comment you replied to.

The scientist has (at the very least) a basic responsibility to perform due diligence. We can argue back and forth over what constitutes appropriate due diligence, but, with regard to the scientist under discussion, I think we'd be better suited discussing what constitutes negligence.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#362
post #292

Surely this is gross professional misconduct? If one of my postdocs did this they would be at risk of being fired. I would certainly never trust them again. If I let it get through, I should be at risk. As a reviewer, if I see the authors lie in this way why should I trust anything else in the paper? The only ethical move is to reject immediately. I acknowledge mistakes and so on are common but this is different leag…

this brings us to a cultural divide, westerners would see this as a personal scar, as they consider the integrity of the publishing sphere at large to be held up by the integrity of individuals

i clicked on 4 of those papers, and the pattern i saw was middle-eastern, indian, and chinese names

these are cultures where they think this kind of behavior is actually acceptable, they would assume it's the fault of the journal for accepting the paper. they don't see the loss of reputation to be a personal scar because they instead attribute blame to the game.

some people would say it's racist to understand this, but in my opinion when i was working with people from these cultures there was just no other way to learn to cooperate with them than to understand them, it's an incredibly confusing experience to be working with them until you understand the various differences between your own culture and theirs

Re: Over fifty new hallucinations in ICLR 2026 submissions

#363

Last month, I was listening to the Joe Rogan Experience episode with guest Avi Loeb, who is a theoretical physicist and professor at Harvard University. He complained about the disturbingly increasing rate at which his students are submitting academic papers referencing non-existent scientific literature that were so clearly hallucinated by Large Language Models (LLMs). They never even bothered to confirm their refer…

Talk about a buried lead... Avi Loeb is, first and foremost, a discredited crank.

That’s implied by the fact he was on the Joe Rogan show.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#364

Earlier quoted context omitted.

It seems like this is the type of thing that LLMs would actually excel at though: find a list of citations and claims in this paper, do the cited works support the claims?

sure, except when they hallucinate that the cited works support the claims when they do not. At which point you're back at needing to read the cited works to see if they support the claims.

You don't just accept the review as-is, though; You prompt it to be a skeptic and find a handful of specific examples of claims that are worth extra attention from a qualified human.

Unfortunately, this probably results in lazy humans _only_ reading the automated flagged areas critically and neglecting everything else, but hey—at least it might keep a little more garbage out?

Re: Over fifty new hallucinations in ICLR 2026 submissions

#365
I’ve been working on tools that specifically address this problem, but from the level upstream of citation. They don’t check whether a citation exists — instead they measure whether the reasoning pathway leading to a citation is stable, coherent, and free of the entropy patterns that typically produce hallucinations.

The idea is simple: • Bad citations aren’t the root cause. • They are a late-stage symptom of a broken reasoning trajectory. • If you detect the break early, the hallucinated citation never appears.

The tools I’ve built (and documented so anyone can use) do three things: 1. Measure interrogative structure — they check whether the questions driving the paper’s logic are well-formed and deterministic. 2. Track entropy drift in the argument itself — not the text output, but the structure of the reasoning. 3. Surface the exact step where the argument becomes inconsistent — which is usually before the fake citation shows up.

These instruments don’t replace peer review, and they don’t make judgments about culture or intent. They just expose structural instability in real time — the same instability that produces fabricated references.

If anyone here wants to experiment or adapt the approach, everything is published openly with instructions. It’s not a commercial project — just an attempt to stabilize reasoning in environments where speed and tool-use are outrunning verification.

Code and instrument details are in my CubeGeometryTest repo (the implementation behind ‘A Geometric Instrument for Measuring Interrogative Entropy in Language Systems’). https://github.com/btisler-DS/CubeGeometryTest This is still a developing process.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#366
post #292

Surely this is gross professional misconduct? If one of my postdocs did this they would be at risk of being fired. I would certainly never trust them again. If I let it get through, I should be at risk. As a reviewer, if I see the authors lie in this way why should I trust anything else in the paper? The only ethical move is to reject immediately. I acknowledge mistakes and so on are common but this is different leag…

this brings us to a cultural divide, westerners would see this as a personal scar, as they consider the integrity of the publishing sphere at large to be held up by the integrity of individuals i clicked on 4 of those papers, and the pattern i saw was middle-eastern, indian, and chinese names these are cultures where they think this kind of behavior is actually acceptable, they would assume it's the fault of the jour…

Where do you see the authors? All I'm seeing is:

>Anonymous authors

>Paper under double-blind review

Re: Over fifty new hallucinations in ICLR 2026 submissions

#367
post #292

Surely this is gross professional misconduct? If one of my postdocs did this they would be at risk of being fired. I would certainly never trust them again. If I let it get through, I should be at risk. As a reviewer, if I see the authors lie in this way why should I trust anything else in the paper? The only ethical move is to reject immediately. I acknowledge mistakes and so on are common but this is different leag…

this brings us to a cultural divide, westerners would see this as a personal scar, as they consider the integrity of the publishing sphere at large to be held up by the integrity of individuals i clicked on 4 of those papers, and the pattern i saw was middle-eastern, indian, and chinese names these are cultures where they think this kind of behavior is actually acceptable, they would assume it's the fault of the jour…

im not sure if you are gonna get downvoted so im sticking a limb out to cop any potential collateral damage in the name of finding out whether the common inhabitant of this forum considers the idea of low trust vs high trust societies to be inherently racist

Re: Over fifty new hallucinations in ICLR 2026 submissions

#368

I recommend actually clicking through and reading some of these papers. Most of those I spot checked do not give an impression of high quality. Not just AI writing assistance but many seem to have AI-generated "ideas", often plausible nonsense. the reviewers often catch the errors and sometimes even the fake citations. can I prove malfeasance beyond a reasonable doubt? no. but I personally feel quite confident many o…

To me such an interpretation suggests there are likely to be papers that were not so easy to spot, perhaps because the AI accidentally happened upon more plausible nonsense and then generated fully non-sense data, which was believable but still (at a reduced level of criticality) nonsense data, to bolster said non-sense theory at a level that is less easy to catch.

This isn't comforting at all.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#369
post #349

Earlier quoted context omitted.

I don’t understand. You’re saying even with crappy tools one should be able to do the job the same as with well made tools?

Three and a half years ago nobody had ever used tools like this. It can't be a legitimate complaint for an author to say, "not my fault my citations are fake it's the fault of these tools" because until recently no such tools were available and the expectation was that all citations are real.

Then it’s just a poor analogy.

Re: Over fifty new hallucinations in ICLR 2026 submissions

#370

Earlier quoted context omitted.

this brings us to a cultural divide, westerners would see this as a personal scar, as they consider the integrity of the publishing sphere at large to be held up by the integrity of individuals i clicked on 4 of those papers, and the pattern i saw was middle-eastern, indian, and chinese names these are cultures where they think this kind of behavior is actually acceptable, they would assume it's the fault of the jour…

Where do you see the authors? All I'm seeing is: >Anonymous authors >Paper under double-blind review

Yeah WTF? Both authors and reviewers are hidden. Is this comment just an attempt to whip up racist fervor?
Post reply on HN