Live data from Hacker News

Please commit more blatant academic fraud

jacobbuckman.com

1–10 of 365 posts

Re: Please commit more blatant academic fraud

#2
I've met Jacob in person and we had a super interesting discussion about RL that sadly petered out during the covid lockdown. This blog post very much fits my impression of him and I give mad probs to shitting on your own work (particularly the thermometer encoding was a pet peeve of mine).

Re: Please commit more blatant academic fraud

#3
It's worth noting: In most of these cases, even when caught, the guilty parties and the bad papers remain unnamed. There are known-to-the-editors fraudulent papers in major journals still being cited.

The consequences of committing academic fraud are minor, and the consequences of not doing so generally mean no academic jobs or tenure.

There isn't a 99.99% innocent claim here (as at the end of the article). This stuff is widespread. This is much more accurate:

"because everybody is complicit in this subtle fraud, nobody is willing to acknowledge its existence"

Littman is at Brown, where the majority of the CS department engages in this !@#$%. I'm not trying to single out Brown. Parts of MIT, Stanford, etc. are even worse.

Re: Please commit more blatant academic fraud

#5
Hmmm.

Here we see the following claim:

> By partaking in a form of fraud that has left the Overton window of acceptability, the researchers in the collusion ring have finally succeeded in forcing the community to acknowledge its blind spot. For the first time, researchers reading conference proceedings will be forced to wonder: does this work truly merit my attention? Or is its publication simply the result of fraud?

But I don't see how this follows. If I follow the link to the description of the actual fraud ( https://cacm.acm.org/magazines/2021/6/252840-collusion-rings... ), it says essentially the opposite: the "fraudulent" papers are no different from papers published by ordinary means.

> the review process is notoriously random. In a well-publicized case in 2014, organizers of the Neural Information Processing Systems Conference formed two independent program committees and had 10% of submissions reviewed by both. The result was that almost 60% of papers accepted by one program committee were rejected by the other, suggesting that the fate of many papers is determined by the specifics of the reviewers selected

> In response, some authors have adopted paper-quality-independent interventions to increase their odds of getting papers accepted. That is, they are cheating.

> Here is an account of one type of cheating that I am aware of: a collusion ring.

> A group of colluding authors writes and submits papers to the conference.

> The colluders share, amongst themselves, the titles of each other's papers, violating the tenet of blind reviewing

> The colluders hide conflicts of interest, then bid to review these papers, sometimes from duplicate accounts, in an attempt to be assigned to these papers as reviewers.

> The colluders write very positive reviews of these papers

So the system is: conferences already can't tell the difference between a good paper and a bad paper. Researchers respond by adopting strategies for passing review that are irrelevant to paper quality (since paper quality doesn't count). But those strategies aren't bad for paper quality. If I'm reading conference papers, why would I worry about whether one of them is the product of review collusion?

Re: Please commit more blatant academic fraud

#8

Hmmm. Here we see the following claim: > By partaking in a form of fraud that has left the Overton window of acceptability, the researchers in the collusion ring have finally succeeded in forcing the community to acknowledge its blind spot. For the first time, researchers reading conference proceedings will be forced to wonder: does this work truly merit my attention? Or is its publication simply the result of fraud?…

> If I'm reading conference papers, why would I worry about whether one of them is the product of review collusion?

Because the one you are reading may have crowded out a better one. Even if the current review system is essentially random, replacing it with something that is essentially a contest of well-connectedness is worse. Young researchers with good ideas but fewer connections, or people from less well-known institutions would have their ideas suppressed.

So you should be worrying about stagnation, and about not reading what might actually be new and exciting.

Re: Please commit more blatant academic fraud

#9

Hmmm. Here we see the following claim: > By partaking in a form of fraud that has left the Overton window of acceptability, the researchers in the collusion ring have finally succeeded in forcing the community to acknowledge its blind spot. For the first time, researchers reading conference proceedings will be forced to wonder: does this work truly merit my attention? Or is its publication simply the result of fraud?…

[deleted]

Re: Please commit more blatant academic fraud

#10
post #3

It's worth noting: In most of these cases, even when caught, the guilty parties and the bad papers remain unnamed. There are known-to-the-editors fraudulent papers in major journals still being cited. The consequences of committing academic fraud are minor, and the consequences of not doing so generally mean no academic jobs or tenure. There isn't a 99.99% innocent claim here (as at the end of the article). This stuf…

With laws, there are full time police officers, investigators, and prosecutors working to catch people. And even then, most crimes go unsolved and unpunished.

Even without the complicity, stopping fraud and bad behavior is a difficult problem. Part time reviewers and reputation seem woefully insufficient counters.

Post reply on HN