Live data from Hacker News

The science that’s never been cited

nature.com

11–20 of 48 posts

Re: The science that’s never been cited

#11

I wonder if part of the reason for uncited papers being so low is that authors cite their own papers in subsequent papers. For example, an author is studying field X, and publishes papers. No one cites the first paper. The author then writes a new paper on X, but cites the first paper. Thus, although no one but the author cited the papers that the author wrote, all but the last one have citations in other papers. Ano…

Exactemente. It's fairly bizarre that this article didn't mention self-citation, huh.

It explicitly does mention self-citation.

Re: The science that’s never been cited

#12

Earlier quoted context omitted.

In the methods section, they do say that "first author self-citations were excluded." One of the figures in the Nature article also pulls out self-citations. https://arxiv.org/abs/0809.5250

Do note however that many times the first author is not the principal investigator (ie the person that has the funding for the study and is often tenure track faculty) but is often a graduate student or a post-doc. The principal investigator may be in the middle or even at the end of the author list. Thus just excluding first author self-citations is probably inadequate. The chances are high that a grad student or po…

[deleted]

Re: The science that’s never been cited

#13
post #11

Earlier quoted context omitted.

Exactemente. It's fairly bizarre that this article didn't mention self-citation, huh.

It explicitly does mention self-citation.

Thanks. I looked again. Are you referring to that one graph? I couldn't find any mention in the text.

Re: The science that’s never been cited

#14
> “Lack of citation cannot be interpreted as meaning articles are useless or valueless,” says David Pendlebury, a senior citations analyst at Clarivate.

On the other hand, presence of citation can not be interpreted as meaning articles are useful or valuable. For one, there could be chains of useless and valueless papers citing each other.

Re: The science that’s never been cited

#15
> Then, checking on Google Scholar, Heneberg saw that many of the remaining papers actually had been referenced by other works indexed in the Web of Science, but had been missed because of data-entry errors or typos in the papers

I wonder if you could look at the number of citations to non-existent papers to find these typos. If you collected such a set, you could do a loose search against the list of published papers, and see how many are a close match. For instance, a typo in an author's name or the paper's title could be ignored while matching the journal, date and page could give the auditors a list of best guesses for this missed citations.

Re: The science that’s never been cited

#16
post #9

10% of papers being completely uncited is a little misleading. There is a long tail of papers with 1 or 2 citations that were hardly read beyond the abstract and only cited to up a paper's number of references and had a few good keywords. That research is effectively uncited. The reason for this isn't really surprising: Most research isn't that groundbreaking. Most research is done because if you don't produce a pape…

To be honest, now that you mentioned this, I'm really curious how warm a squirrel's tail is.

Re: The science that’s never been cited

#17
I like how the 3dB point for engineering papers is 4 years (that is where 50% of the papers remain uncited). I am a bit surprised it goes down from there. I have always felt that a big chunk of the engineering or technical papers out there reference technology that is obsolete after 5 years[1]. There are the seminal papers of course, the ones that it seems are always cited, but a huge chunk which were useful when published, are much less so later.

[1] No I don't have a citation :-) but having written a few papers and looking for related work I found the chance of finding something relevant dropped precipitously when you got into papers that were more than a few years old.

Re: The science that’s never been cited

#18
post #9

10% of papers being completely uncited is a little misleading. There is a long tail of papers with 1 or 2 citations that were hardly read beyond the abstract and only cited to up a paper's number of references and had a few good keywords. That research is effectively uncited. The reason for this isn't really surprising: Most research isn't that groundbreaking. Most research is done because if you don't produce a pape…

To be honest, now that you mentioned this, I'm really curious how warm a squirrel's tail is.

Seriously, you should write a paper on it when you learn

Re: The science that’s never been cited

#19
post #9

10% of papers being completely uncited is a little misleading. There is a long tail of papers with 1 or 2 citations that were hardly read beyond the abstract and only cited to up a paper's number of references and had a few good keywords. That research is effectively uncited. The reason for this isn't really surprising: Most research isn't that groundbreaking. Most research is done because if you don't produce a pape…

While I sympathize with your sentiment - indeed much research is done that is incremental, not groundbreaking - your comment does not accurately describe academic research.

Full-time scientist positions, whether in academia or elsewhere, are competitive in the extreme. Even with tenure protections, if your hypothetical researcher does not generate impactful research, he or she could expect to be out of a job in relatively short order. In other words, just publishing a paper is not enough anymore. Scientists are constantly evaluated by their peers, not just in the form of peer review. PIs, in particular, are judged harshly by the amount and quality ("impact") of their work, and the grant money they bring in. (Fun fact: usually about half of all grants just go to the university; the PI only gets to keep, and use, a fraction of it.)

Of course nowadays most PIs do not write the papers themselves. Most of the writing falls on postdocs and graduate students. The PIs are full-time writing grant proposals to fund such work. (Of course anything else, including teaching classes or advising graduate students, goes on top of this full-time job.) As any practicing scientist can tell you, grant committees fall easily for fashion and fad, which in the scientific community are driven by citations.

The scientific process today is dominated by the grant mechanism, which is cyclic by design. A PI, when awarded a grant, funds grad students/postdocs/junior staff to produce research that is documented in the form of publications. These publications are used in turn as justification for a new grant, which will fund the next round of research. Citation-less papers are primarily useless in this regard, as the first evaluation a grant committee will make - often before even considering the scientific justification - is to examine the impact of the published work justifying it, which is usually measured algorithmically (citation number.) (Incidentally, the next step a grant committee will make is examining the reputation of the PI, which is a longer-term reflection of... citations.) It isn't hard to see why this incentivizes incremental work - groundbreaking work is risky and might not pay off; it takes time and resources, which are hard to obtain; and incremental work establishes a larger and more visible presence in the field, which is more likely to be noticed.

To put it simply, in nearly all realistic scenarios - excluding very prestigious (and rare) open-ended fellowships that ask no questions of the researcher - the reason that paper on the insulating properties of squirrel tails would exist is because a grant was awarded funding that research. In other words, because somebody gave a crap about it.

Re: The science that’s never been cited

#20
post #9

10% of papers being completely uncited is a little misleading. There is a long tail of papers with 1 or 2 citations that were hardly read beyond the abstract and only cited to up a paper's number of references and had a few good keywords. That research is effectively uncited. The reason for this isn't really surprising: Most research isn't that groundbreaking. Most research is done because if you don't produce a pape…

The squirrel cares.
Post reply on HN