Live data from Hacker News

Authors’ names have ‘astonishing’ influence on peer reviewers: study

nature.com

11–20 of 319 posts

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#11
post #5
post #4

Is it any different to podcasts, concerts, and books? People will choose what they listen, see, or read heavily based on who the performer is. A performer who has consistently given good content will obviously have a bigger pull than a nobody still trying to get their first break.

Podcasts, concerts and books are something we review subjectively. Scientific articles one would expect would be reviewed objectively.

That expectation goes against human nature. Although I too wish it was true.

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#12

How is double blind not the norm? there is just too much room for bias

If you want a review to be truly double blind, you have to start censoring the paper -- things like "in previous work [1-10] we showed..." makes it obvious who the authors are even if you remove the names from the top of the paper.

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#13
post #5
post #4

Is it any different to podcasts, concerts, and books? People will choose what they listen, see, or read heavily based on who the performer is. A performer who has consistently given good content will obviously have a bigger pull than a nobody still trying to get their first break.

Podcasts, concerts and books are something we review subjectively. Scientific articles one would expect would be reviewed objectively.

The data in a paper can be objectively measured, the methodology used to conduct a study - like sample size, cohort composition, cohort groups chosen for comparison - could go both ways, the conclusions drawn are often subjective. If two of the three component parts of a paper are arguably subjective, not surprising that Nobel Prize winners get a pass on the quality of their papers.

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#14

How is double blind not the norm? there is just too much room for bias

If you want a review to be truly double blind, you have to start censoring the paper -- things like "in previous work [1-10] we showed..." makes it obvious who the authors are even if you remove the names from the top of the paper.

You do not have to censor: you simply refer to yourselves in the third person to make your shared identity plausibly deniable. A work that is worthy of being of publication should largely be able to stand on its own anyway. This may have the effect of reducing minimum publishable unit (MPU) CV spam papers as a bonus.

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#15

It seems to me that some subjects are so specialized that the group that makes up one's 'peers' is fairly small. How do they have real anonymized reviews when it becomes easy to recognize the writings of the author? The more papers that someone writes, the easier it would be for their peers to recognize the writing style and other quirks that would give the author away.

It might happen unconsciously. But in my experience it's not that easy for a reviewer to consciously use writing cues for anything useful.

Sometimes it seems very obvious that a given paper is by specific authors (either because of style, or because of how familiar it is with their previous work) but I've had many experiences where I later learned that my supposition was completely wrong. Similarly, when you encounter a paper that doesn't have any obvious cues (which is the overwhelming majority of them) then it's pretty much impossible to tell whether it's an author you admire or someone you've never heard of -- and this is a good thing.

Some conferences don't use blind submissions, and yes: I have felt an awful lot of influence there. "Surely [famous Turing-award winning authors] don't need me to double-check their proof."

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#16
post #3

"A Nobel prizewinner is six times more likely than someone less well known to get a thumbs-up for acceptance, finds study." Lifehack discovered: legally change your name to that of a Nobel prizewinner if pursuing academia.

Old news from 2016 Jobseekers with Anglo-Saxon, easy to pronounce and common names are the most likely to get to the interview stage compared to candidates with unfamiliar names, according to research by the Australian National University published in the Oxford Bulletin of Economics and Statistics. https://www.independent.co.uk/news/business/news/unusual-nam...

"Nobel and Novice: Author Prominence Affects Peer Review" https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4190976

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#17
post #5
post #4

Is it any different to podcasts, concerts, and books? People will choose what they listen, see, or read heavily based on who the performer is. A performer who has consistently given good content will obviously have a bigger pull than a nobody still trying to get their first break.

Podcasts, concerts and books are something we review subjectively. Scientific articles one would expect would be reviewed objectively.

The only people who could possibly think that are the ones who have never gotten anything published.

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#19
post #3

"A Nobel prizewinner is six times more likely than someone less well known to get a thumbs-up for acceptance, finds study." Lifehack discovered: legally change your name to that of a Nobel prizewinner if pursuing academia.

Old news from 2016 Jobseekers with Anglo-Saxon, easy to pronounce and common names are the most likely to get to the interview stage compared to candidates with unfamiliar names, according to research by the Australian National University published in the Oxford Bulletin of Economics and Statistics. https://www.independent.co.uk/news/business/news/unusual-nam...

[deleted]

Re: Authors’ names have ‘astonishing’ influence on peer reviewers: study

#20
This reminds me of a bias I saw on Quora, where some popular contributor gets tons of upvotes by fans regardless of whether their answer is any good or not (often you have to dig deep into the comments to find out that it's not a good answer). (I should qualify that I don't know if it's still that way; I started using it when it was first launched and then quit 6-7 years ago once it started turning into a fanboi and you-upvote-me-I-upvote-you club.)
Post reply on HN