Live data from Hacker News

Time to break academic publishing's stranglehold on research

newscientist.com

21–30 of 312 posts

Re: Time to break academic publishing's stranglehold on research

#21
post #19

Add in that the quality of the system is massively massively broken...peer review is about as accurate as the flip of a coin. It does not promote gorund breaking or novel research, it barely (arguably doesn't) even contribute to quality research. I had a colleague recently be told by a journal editor 'we don't publish critiques from junior scholars.' So much for the nature of peer review being entirely driven by the…

What would be a good alternative to peer-review though? Genuinely interested.

Re: Time to break academic publishing's stranglehold on research

#22

Earlier quoted context omitted.

How do peer reviews happen, then, if nobody gets paid to do them? Does research money (that goes to the production of the paper) not also cover peer-reviews? I wouldn't see any incentive for any work to be peer-reviewed, ever, then.

I'm a math professor, I can answer this. We tend to think of journals as being run by their editorial boards -- i.e., by scientists in our field. The publishers are in the background, not taking a very active role, simply skimming off truckloads of money in the process. In particular, peer-review requests tend to come from scientists whom we know at least by reputation, and often personally. When I spend serious time…

The editors of a prestigious linguistics journal actually gave Elsevier the middle finger a while back. Here's a good summary: http://languagelog.ldc.upenn.edu/nll/?p=22162.

Economics and linguistics also publish their own journals which costs some money but significantly less than Elsevier's subscriptions (I believe linguistics' is 300 USD per year). There's probably enough momentum behind middlemen-run journals that prevents this from happening more en masse.

Re: Time to break academic publishing's stranglehold on research

#23
post #19

Add in that the quality of the system is massively massively broken...peer review is about as accurate as the flip of a coin. It does not promote gorund breaking or novel research, it barely (arguably doesn't) even contribute to quality research. I had a colleague recently be told by a journal editor 'we don't publish critiques from junior scholars.' So much for the nature of peer review being entirely driven by the…

What would be a good alternative to peer-review though? Genuinely interested.

It strikes me that the challenge of peer review is that it is non-transparent, and gate-keeping. It is impossible for one to read the peer review feedback related to a published paper, and it's similarly difficult to publish controversial pieces that break established norms.

Contrast this to the peer review culture of popular open source projects - major pull requests have extensive and transparent dialogue, and disagreements known. Meanwhile there is no barrier to releasing anything new.

Re: Time to break academic publishing's stranglehold on research

#24
post #19

Add in that the quality of the system is massively massively broken...peer review is about as accurate as the flip of a coin. It does not promote gorund breaking or novel research, it barely (arguably doesn't) even contribute to quality research. I had a colleague recently be told by a journal editor 'we don't publish critiques from junior scholars.' So much for the nature of peer review being entirely driven by the…

What would be a good alternative to peer-review though? Genuinely interested.

Open publishing and commenting would be a good start---having a dialog, like is done at conferences. Older academic journal articles (pre 1900) read much more like discussions than like the hundred dollar word vomits of modern academic publishing. The broken incentives are at the core of this rotten fruit, though. Just making journals open isn't enough.

Re: Time to break academic publishing's stranglehold on research

#25

Earlier quoted context omitted.

How do peer reviews happen, then, if nobody gets paid to do them? Does research money (that goes to the production of the paper) not also cover peer-reviews? I wouldn't see any incentive for any work to be peer-reviewed, ever, then.

I'm a math professor, I can answer this. We tend to think of journals as being run by their editorial boards -- i.e., by scientists in our field. The publishers are in the background, not taking a very active role, simply skimming off truckloads of money in the process. In particular, peer-review requests tend to come from scientists whom we know at least by reputation, and often personally. When I spend serious time…

> If I get asked to peer-review a paper that looks uninteresting to me, or something outside my interests and expertise, ... or write a quick report recommending that the paper not be accepted.

That seems kind of harsh?

Re: Time to break academic publishing's stranglehold on research

#26
post #19

Add in that the quality of the system is massively massively broken...peer review is about as accurate as the flip of a coin. It does not promote gorund breaking or novel research, it barely (arguably doesn't) even contribute to quality research. I had a colleague recently be told by a journal editor 'we don't publish critiques from junior scholars.' So much for the nature of peer review being entirely driven by the…

What would be a good alternative to peer-review though? Genuinely interested.

I think the op is not saying that peer review as a concept is broken, more that the current peer review system is broken.

I think we could start fixing things by incentivizing good peer review. There’s a lot of ways to do this and I’d be interested in a discussion of different schemes. It will by no means be easy but I think that’s what needs to happen.

Re: Time to break academic publishing's stranglehold on research

#27
post #19

Add in that the quality of the system is massively massively broken...peer review is about as accurate as the flip of a coin. It does not promote gorund breaking or novel research, it barely (arguably doesn't) even contribute to quality research. I had a colleague recently be told by a journal editor 'we don't publish critiques from junior scholars.' So much for the nature of peer review being entirely driven by the…

What would be a good alternative to peer-review though? Genuinely interested.

For many STEM fields, conference talks, presentations and written contributions are notably faster and better suited to non-tenured applied researchers than the journals route.

Re: Time to break academic publishing's stranglehold on research

#28
post #11

For anyone who still doesn't know this: publishers do not pay paper authors, in any field. I am also not aware of a publisher paying peer reviewers. (Lowly soon-to-be-postdoc here; a professor would be able to say more.)

In academia (at least the hard sciences), no faculty are ever paid for publishing in mainstream, peer-reviewed journals. No reviewers are ever paid either, although recently Elsevier has started to publish the names of its "star reviewers", presumably as a token for the large investment in time and expertise required to evaluate papers for publication and improve the field. Even book deals (or editorships) yield no r…

I’ve actually heard of some Chinese universities awarding profs something like $150,000 for getting an article published in nature[1].

[1] https://www.economist.com/china/2018/11/17/tsinghua-universi...

Re: Time to break academic publishing's stranglehold on research

#29
post #24

Earlier quoted context omitted.

What would be a good alternative to peer-review though? Genuinely interested.

Open publishing and commenting would be a good start---having a dialog, like is done at conferences. Older academic journal articles (pre 1900) read much more like discussions than like the hundred dollar word vomits of modern academic publishing. The broken incentives are at the core of this rotten fruit, though. Just making journals open isn't enough.

We have (almost) open publishing and open commenting. Did that improve anything?

Re: Time to break academic publishing's stranglehold on research

#30

Earlier quoted context omitted.

I'm a math professor, I can answer this. We tend to think of journals as being run by their editorial boards -- i.e., by scientists in our field. The publishers are in the background, not taking a very active role, simply skimming off truckloads of money in the process. In particular, peer-review requests tend to come from scientists whom we know at least by reputation, and often personally. When I spend serious time…

> If I get asked to peer-review a paper that looks uninteresting to me, or something outside my interests and expertise, ... or write a quick report recommending that the paper not be accepted . That seems kind of harsh?

I reacted when I read this as well. I am hoping he meant that he would recommend that paper to be published/not published...

...I fear however that my hopes are in vain

Post reply on HN