Live data from Hacker News

An Elaborate Academic-Journal Hoax

chronicle.com

11–20 of 165 posts

Re: An Elaborate Academic-Journal Hoax

#11
Can someone comment on whether these are respectable journals or not, within their fields?

Every few years someone will do a Sokal-hoax-esque thing in scientific fields, but usually they're just getting a paper into very-low-quality predatory journals that have only a nominal peer review process.

I'm wondering if that's what happened here. Do humanities fields even have the same set of incentives leading to a proliferation of those sorts of journals?

Re: An Elaborate Academic-Journal Hoax

#12
Most published stuff is irrelevant crap that will never be cited or included in the central canon. This is true even in computer science. Also, as we know from computer security, system design becomes massively more difficult if it requires hardening against malicious actors. The presumption of good faith is a valuable component of any community that shouldn't be abused to score stupid points.

For these reasons, Sokal Hoaxes (and their like) are damaging wastes of time and the perpetrators should not be praised.

Re: An Elaborate Academic-Journal Hoax

#13
post #2

Representative quote: > "I am so utterly unimpressed," wrote Jacob T. Levy, a political theorist at McGill University, "by the fact that an enterprise that relies on a widespread presumption of not-fraud can be fooled some of the time by three people with Ph.D.s who spend 10 months deliberately trying to defraud it."

> can be fooled some of the time

7⁄20 or 7⁄17, depending on how you want to count is concerning.

Re: An Elaborate Academic-Journal Hoax

#15
post #7
post #2

Representative quote: > "I am so utterly unimpressed," wrote Jacob T. Levy, a political theorist at McGill University, "by the fact that an enterprise that relies on a widespread presumption of not-fraud can be fooled some of the time by three people with Ph.D.s who spend 10 months deliberately trying to defraud it."

Shouldn't the default presupposition of any research be a lack of novelty?

I think generally people tend to assume that colleagues aren't dishonest, and mostly peer-review is supposed to catch honest mistakes.

You could try working without any faith in your colleagues of course, but you are probably better of switching workplace if that sounds like reasonable behaviour to you.

Re: An Elaborate Academic-Journal Hoax

#16

I've been more disturbed by the response to this than the papers themselves. Saying,well of course we were duped, you really expected the peer review system to not to utterly fail in the presence of a few bad actors? does not inspire my faith in the system.

That's what stuck out to me as well. This quote: "I am so utterly unimpressed," wrote Jacob T. Levy, a political theorist at McGill University, "by the fact that an enterprise that relies on a widespread presumption of not-fraud can be fooled some of the time by three people with Ph.D.s who spend 10 months deliberately trying to defraud it." Isn't the ability to separate out the quality work from the garbage the poin…

> an enterprise that relies on a widespread presumption of not-fraud

This is section really gets me. How in the world is science supposed to rely on “not-fraud”? Sure if you fake your data you might dupe a diligent reviewer, but this is why results are supposed to be reproduced.

Anything that relies on “not-fraud” seems inherently unscientific and straight up naive.

Re: An Elaborate Academic-Journal Hoax

#18
post #2

Representative quote: > "I am so utterly unimpressed," wrote Jacob T. Levy, a political theorist at McGill University, "by the fact that an enterprise that relies on a widespread presumption of not-fraud can be fooled some of the time by three people with Ph.D.s who spend 10 months deliberately trying to defraud it."

Alternative take: A system designed to detect bad research failed to detect blatant falsehoods, algorithmically generated noise, rabid propaganda and other seemingly easy things to detect. That PhDs worked on this doesn’t mean the system didn’t fail spectacularly.

Re: An Elaborate Academic-Journal Hoax

#19

I've been more disturbed by the response to this than the papers themselves. Saying,well of course we were duped, you really expected the peer review system to not to utterly fail in the presence of a few bad actors? does not inspire my faith in the system.

That's what stuck out to me as well. This quote: "I am so utterly unimpressed," wrote Jacob T. Levy, a political theorist at McGill University, "by the fact that an enterprise that relies on a widespread presumption of not-fraud can be fooled some of the time by three people with Ph.D.s who spend 10 months deliberately trying to defraud it." Isn't the ability to separate out the quality work from the garbage the poin…

You better pay reviewers anything at all if you want them to produce few type 2 errors.

Re: An Elaborate Academic-Journal Hoax

#20
post #8

It's not just the humanities, computer science is also susceptible to hoaxes built from jargon. SCIgen works like an academic "Mad Libs" of sorts, arbitrarily slotting in computer-science buzzwords like "distributed hash tables" and "Byzantine fault tolerance." http://news.mit.edu/2015/how-three-mit-students-fooled-scien...

That paper was accepted as a non-reviewed paper. There was no peer-review process.
Post reply on HN