> I have pledged to no longer do any volunteer work, including reviewing, for non-open access publications, which unfortunately includes pretty much every publication from [commercial-publisher]. The volunteer aspect of peer review is the worst part. How much is an expert's time worth? How much is a two-sentence review worth to an author? If it were paid on an hourly basis using an honor system, it would be fantastic…
ML researcher replies to request to review paper for closed journal
11–20 of 26 posts
Re: ML researcher replies to request to review paper for closed journal
#12Jelte M. Wicherts, Rogier A. Kievit, Marjan Bakker and Denny Borsboom. Letting the daylight in: reviewing the reviewers and other ways to maximize transparency in science. Front. Comput. Neurosci., 03 April 2012 doi: 10.3389/fncom.2012.00020
http://www.frontiersin.org/Computational_Neuroscience/10.338...
for making the peer-review process in scientific publishing more rewarding and more reliable too. Wicherts does a lot of research on this issue to try to reduce the number of dubious publications in his main discipline, the psychology of human intelligence.
"With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses."
Re: ML researcher replies to request to review paper for closed journal
#13Re: ML researcher replies to request to review paper for closed journal
#14In my opinion, Yann LeCun is one of the top celebrities in ML/Neural Net research. His voice really has weight.
Re: ML researcher replies to request to review paper for closed journal
#15Re: ML researcher replies to request to review paper for closed journal
#16Re: ML researcher replies to request to review paper for closed journal
#17The reason he gave is that while he is at a stage in his career where there is no pressure to publish in any particular set of journals and so can exercise discretion in where he publishes, he recognizes that some mathematicians, for reasons beyond their control, are unable to do so, and he does not wish to penalize them.
For fields where many of the high impact journals are not yet open access, I think Tao's approach makes sense. Publishing in high impact journals greatly helps the careers of young researchers.
Re: ML researcher replies to request to review paper for closed journal
#18Terry Tao made a good point when he joined the boycott of Elsevier journals. He said he would stop submitting to their journals, and stop doing editorial work for them, but declined to stop reviewing papers. The reason he gave is that while he is at a stage in his career where there is no pressure to publish in any particular set of journals and so can exercise discretion in where he publishes, he recognizes that som…
Re: ML researcher replies to request to review paper for closed journal
#19Re: ML researcher replies to request to review paper for closed journal
#20Professors and researchers should start charging for time spent helping the closed journals at the very least. If you think your reviews are valuable, charge accordingly. You provide value to the publishing process and should capture that value. You are providing the service of "expertise". If you provided that service to a lawyer, you would earn several hundred dollars an hour. There's probably a business opportunit…
Basically, it's a zero sum game. So if everybody paid for the reviews they did and then got paid for doing reviews, a lot of money would change hands and everybody would end up with the same amount of money they had to start with.
Of course, the companies that _publish_ the journals take a cut. But that's what it is, a cut. There are really communities of professors participating in a zero sum game.