Live data from Hacker News

Hundreds of extreme self-citing scientists revealed in new database

nature.com

51–60 of 215 posts

Re: Hundreds of extreme self-citing scientists revealed in new database

#51
post #20

Earlier quoted context omitted.

If you work in a very narrow field of science you're basically on your own and have to cite yourself because there's nobody else to cite.

In which case you have to ask yourself, are you so brilliant that you’ve found an important topic that no one has considered yet, or have all the brilliant people already figured out that topic isn’t worthy of study? It’s the same with the startup world. If you’re the only one doing a thing, are you brilliant or foolish?

Two economists are walking down the street. One sees a $20 bill and starts to bend over to pick it up. The other economist says "Don't bother - if it were really worth $20, someone else would have picked it up."

There's countless numbers of scientists that made great strides working on topics others deemed rediculous. Heck, many of the Nobel prize winners were ridiculed by their colleagues as borderline wack-jobs at the time they were working on their research. Even after winning the prize, some still were with their later work (Crick's search for consciousness comes to mind, and why it would be so worthless a search does not).

If anything, the hubris of the scientific community would be as deafening as the pseudo-science BS and hold back progress just as much if not more except for one key thing: the scientific method.

Luckily, we have a process by which crackpots get differentiated from geniuses. So let's not leave $20 on the ground assuming others would have picked it up, especially when that $20 represents collective progress for the entire species.

Re: Hundreds of extreme self-citing scientists revealed in new database

#52

Earlier quoted context omitted.

I don't see that it's the Cobra effect. Did it actively make them less productive?

Publication standards are different between disciplines. Traditionally, a materials chemist publishes many times more papers than a structural biologist. With a metric like that, you run whole sub-disciplines out of town.

Reminds me of a theater professor I know who was having trouble meeting the new rigorous rules for tenure.

Publish? What and where exactly?

Re: Hundreds of extreme self-citing scientists revealed in new database

#53
I'm not Italian... and am not meeting any productivity threshold.

But my work is incremental, and I obviously don't want to repeat what I said in a different paper, so I cite earlier work in later work. TBH, I don't think it's possible to avoid self-citation unless:

1. Your research is so popular that by the time you need to cite it, it's been surveyed, or improved upon, or otherwise adapted. 2. You switch research subjects relatively often. 3. You publish "blocks" of work, each based on fundamentals in your field established by others - and they're not incremental.

Re: Hundreds of extreme self-citing scientists revealed in new database

#54
post #49

Earlier quoted context omitted.

I don't see that it's the Cobra effect. Did it actively make them less productive?

People who are rewarded are the people most cited, even if they are citing themselves. Think that’s producing the best scientific results?

> Think that’s producing the best scientific results?

That's a strawman. The answer you were looking for is, "I don't know". I don't know either.

Re: Hundreds of extreme self-citing scientists revealed in new database

#55
post #36
post #22

Earlier quoted context omitted.

>In which case you have to ask yourself, are you so brilliant that you’ve found an important topic that no one has considered yet, or have all the brilliant people already figured out that topic isn’t worthy of study? Imagine how many inventions we would have missed if all inventors had shared your mindset.

I think you’ve misinterpreted what I said. I’m not suggesting everyone is a fool, quite the opposite. It’s just an important question to ask yourself.

The purpose of PHDs are to move human knowledge forward. You have to do an analysis of something that, in all likelihood, nobody has done before (or not enough to be considered settled).

Re: Hundreds of extreme self-citing scientists revealed in new database

#56
As someone who now works in astronomy, I'm not at all surprised at the high self-citation rate for the field. It is true that a lot of papers are published by large consortiums. For example, at LSST (where I work), if you have been working on the project for 2 years, you are considered a "builder" and added as an author to all major project wide papers.

Those papers, which tend to be long and full of great stuff, are cited a lot, and have hundreds of authors.

I wonder how many of these papers are where the first author has cited other papers where they are the first author. (Or really, at least the first few authors) It seems like for the data shown, it is just if anyone in the author list is anywhere in the author list of the citation?

Also for some research niches, you may be one of the few people writing papers on a subject. There's no one else to cite.

I do think there's some very valid points about bringing the person up to speed on previous research that brought them to the current paper. But I don't think those citations should really count as a citation in terms of metrics for how successful a scientist is.

To be honest, I find all the metric gaming about number of papers and citations to be ridiculous. I don't hear many people saying they want to write the best paper in their field, or something new. It all seems to be a numbers game these days. Academic career growth hacking, if you will.

Re: Hundreds of extreme self-citing scientists revealed in new database

#57
post #21

The core problem here is that universities think that citation statistics are a useful metric to evaluate the quality of the work of a scientist. There's plenty of evidence that this is not the case or that even the reverse may be the case [1], but this idea refuses to die. [1]

It sucks as a metric but it does have some rough correlation in most cases, and I'm not aware of any better easily measurable metric - if you have one in mind, it'd be great to hear. The alternative of having a bureaucrat "simply judge quality" IMHO is even worse, even less objective, and even more prone to being gamed.

The main problem is that there is an objective need (or desire?) by various stakeholders to have some kind of metric that they can use to roughly evaluate the quality or quantity of scientist's work, with the caveat people outside your field need to be able to use it. I.e. let's assume that we have a university or government official that for some valid reason (there are many of them) needs to be able to compare two mathematicians without spending excessive time on it. Let's assume that the official is honest, competent and in fact is a scientist him/herself and so can do the evaluation "in the way that scientists want" - but that official happens to be, say, a biologist or a linguist. What process should be used? How should that person distinguish insigtful, groundbreaking novel and important research from pseudoscience or salami-sliced paper that's not bringing anything new to the field? I can evaluate papers and people in my research subfield, but not far outside of it. Peer review for papers exists because we consider that people outside of the field are not qualified to directly tell whether that paper is good or bad.

The other problem, of course, is how do you compare between fields - what data allows you to see that (for example) your history department is doing top-notch research but your economics department is not respected in their field?

I'm not sure that a good measurement can exist, and despite all their deep flaws it seems that we actually can't do much better than the currently used bibliographic metrics and judgement by proxy of journal ratings.

Saying "metric X is bad" doesn't mean "metric X shouldn't get used" unless a better solution is available.

Re: Hundreds of extreme self-citing scientists revealed in new database

#58

Earlier quoted context omitted.

More like Goodhart‘s law: "When a measure becomes a target, it ceases to be a good measure."

I'd never seen that, and it reminds me of Heisenberg's Uncertainty Principle somehow.

Heisenberg's principle says that when you measure one thing, you lose track of others. I guess it's kind of complementary to this (except that it applies to very different things, obviously).

Re: Hundreds of extreme self-citing scientists revealed in new database

#59
post #49

Earlier quoted context omitted.

People who are rewarded are the people most cited, even if they are citing themselves. Think that’s producing the best scientific results?

> Think that’s producing the best scientific results? That's a strawman. The answer you were looking for is, "I don't know". I don't know either.

I’d say it makes Publish or perish even worse:

https://en.m.wikipedia.org/wiki/Publish_or_perish

Re: Hundreds of extreme self-citing scientists revealed in new database

#60
post #5

People who are working out their ideas far outside the mainstream have no one to cite but them selves. Some are quacks, to be sure, but sometimes a field is just not ready for their work because the utility of the idea is not easily apparent, or because it's perceived to be too risky. A field needs a healthy mix of the the curmudgeonly stubborn thinkers going their way no matter the cost, and those making steady prog…

Do you have any good examples, historical or otherwise?

Between the two authors here (McKinsey and Tarski), they cite each other 7 times, with 14 citations, giving 50% outgoing self-citation, however this paper also received incoming citations contemporaneously...

https://doi.org/10.2307/2268135

Post reply on HN