Live data from Hacker News

New academic journal only publishes 'unsurprising' research rejected by others

cbc.ca

121–130 of 207 posts

Re: New academic journal only publishes 'unsurprising' research rejected by others

#121
post #29

Earlier quoted context omitted.

My experience: I proposed a thesis to an advisor who deemed it unlikely to work. He ran it by a colleague who came to the same conclusion. I went to a different major and pursued the same thesis and invited the previous faculty who initially turned it down to the defense because it was relevant to their field. It was frustrating to hear them voice their opinions in the defense that they felt, “of course it world work…

https://en.wikipedia.org/wiki/Hindsight_bias

I recall Dan Ariely mentioning this in one of his books. His field is psychology/behavioural economics, a field where very often either outcome of an experiment can seem obvious after the fact. (Questions like Do newborn babies have an intuitive understanding of gravity?)

As I recall, he restructured his lectures, asking upfront for a show of hands as to which outcome everyone anticipated, before the big reveal. After making this change, he had fewer people approaching him after lectures saying how obvious the outcome was.

Re: New academic journal only publishes 'unsurprising' research rejected by others

#122

Half of my PhD thesis is considered "unpublishable" because, after doing the work, my supervisors felt it's actually "unsurprising" that it didn't work out. We took methods that had been exploited to improve on previous results for over a decade to their logical extreme, and found that this method no longer leads to improvements. After doing the work it seems obvious. A paper on the subject would almost be considered…

> We took methods that had been exploited to improve on previous results for over a decade to their logical extreme, and found that this method no longer leads to improvements.

This actually sounds like a really good review paper! Review papers serve multiple purposes: getting people up to speed on a subject, and putting your own spin on a subject to guide future investigation.

Re: New academic journal only publishes 'unsurprising' research rejected by others

#124
post #29

Half of my PhD thesis is considered "unpublishable" because, after doing the work, my supervisors felt it's actually "unsurprising" that it didn't work out. We took methods that had been exploited to improve on previous results for over a decade to their logical extreme, and found that this method no longer leads to improvements. After doing the work it seems obvious. A paper on the subject would almost be considered…

My experience: I proposed a thesis to an advisor who deemed it unlikely to work. He ran it by a colleague who came to the same conclusion. I went to a different major and pursued the same thesis and invited the previous faculty who initially turned it down to the defense because it was relevant to their field. It was frustrating to hear them voice their opinions in the defense that they felt, “of course it world work…

I guess the lesson is, when an advisor rejects your thesis idea, get them to put their reasons in writing.

Re: New academic journal only publishes 'unsurprising' research rejected by others

#125

Earlier quoted context omitted.

https://en.wikipedia.org/wiki/Hindsight_bias

I recall Dan Ariely mentioning this in one of his books. His field is psychology/behavioural economics, a field where very often either outcome of an experiment can seem obvious after the fact. (Questions like Do newborn babies have an intuitive understanding of gravity? ) As I recall, he restructured his lectures, asking upfront for a show of hands as to which outcome everyone anticipated, before the big reveal. Aft…

Do you know which book?

Re: New academic journal only publishes 'unsurprising' research rejected by others

#126
post #120

Earlier quoted context omitted.

That sucks to hear. Null results are important, as you say, if only to dissuade others from doing the same. See also the "file-drawer problem" ( https://en.wikipedia.org/wiki/Publication_bias ). Also, with regards to the incentives in the field and the lack of null results, there's always Ioannidis's classic work ( https://journals.plos.org/plosmedicine/article?id=10.1371/jo... ).

I disagree. Negative results are important. Null results are of very limited interest. The two are worlds apart. A null result simply means you tried something and it didn't work. But you don't know why. You haven't proven it didn't work. There are literally millions of reasons why something might not work. For instance, you could try to use compound X to cure disease Y, observe no effect, and conclude that X doesn't…

> Negative results are important. Null results are of very limited interest.

Correct. There is a highly cited paper in CS where the author showed that a mathematical model that was widely used in research didn't actually work (anymore) in reality. That paper was the starting point of a lot of new research in that field.

Re: New academic journal only publishes 'unsurprising' research rejected by others

#127

Half of my PhD thesis is considered "unpublishable" because, after doing the work, my supervisors felt it's actually "unsurprising" that it didn't work out. We took methods that had been exploited to improve on previous results for over a decade to their logical extreme, and found that this method no longer leads to improvements. After doing the work it seems obvious. A paper on the subject would almost be considered…

Would it be possible for you to upload the paper to researchgate.net ?

Re: New academic journal only publishes 'unsurprising' research rejected by others

#128
It is an improvement over the current situation but the question remains what these journals are good for besides gobbling up money that should go to research instead. There are preprint servers. If they can create a comment system where scientists can leave comments what are journals good for anymore?

Re: New academic journal only publishes 'unsurprising' research rejected by others

#129
As a non-academic: this journal will presumably end up with a low impact factor, right? So it might help with the problem of negative results not getting published at all, but it doesn't address the 'academic penalty' for getting negative results, right?

Seems to me that preregistration [0] is the real answer here. If all journals went with preregistration, there'd be no need for a journal like this, right?

[0] https://plos.org/open-science/preregistration/

Re: New academic journal only publishes 'unsurprising' research rejected by others

#130

Earlier quoted context omitted.

I recall Dan Ariely mentioning this in one of his books. His field is psychology/behavioural economics, a field where very often either outcome of an experiment can seem obvious after the fact. (Questions like Do newborn babies have an intuitive understanding of gravity? ) As I recall, he restructured his lectures, asking upfront for a show of hands as to which outcome everyone anticipated, before the big reveal. Aft…

Do you know which book?

It's one of the three of his books I own, I'm afraid I can't easily narrow it down further. (I own all three as audiobooks, and I recall Simon Jones reading it, but it turns out he read all three.)

• Predictably Irrational

• The (Honest) Truth About Dishonesty

• The Upside of Irrationality

Post reply on HN