Live data from Hacker News

Fake scientific papers are alarmingly common

science.org

91–100 of 105 posts

Re: Fake scientific papers are alarmingly common

#91

The researchers in this paper use an astonishingly biased "fake paper detector", requiring only two conditions to be met for any paper to be considered "fake": 1. Use a non-institutional email address, or have a hospital affiliation, 2. Have no international co-authors. And they acknowledge 86% sensitivity and 44% specificity. It's a coin-toss which biases massively against research from outside the US and Western Eu…

So reading the actual article and the study they cite (https://www.medrxiv.org/content/10.1101/2023.05.06.23289563v...), there's a pretty compelling story being told.

Paper mills are a $3-4 billion dollar industry that is growing rapidly. That money isn't coming from nowhere. There are a lot of fake papers, and the fake paper industry is growing steadily.

So then the question becomes "where are those fake papers being published, and by whom."

You can converge on answers to those questions in a lot of ways. The fake paper detection method is suggested as one tool to aid journals tackle fraud.

If you don't think the conditions are valid, well, ok. But why not? How would you improve on the validation methodology? Obviously having more known fakes would be nice.

Saying the article is "bigoted nonsense" doesn't make a lot of sense without more information (to be fair, I might be lacking crucial context). Are the authors known bigots with history of pushing bigotry? What I read seemed to be a sincere attempt to improve scientific publication practices by identifying the scope and scale of the fraud problem, while also developing means to address it. That doesn't strike me as bigoted nonsense.

That said, the headline of the article is pretty click-baity, and shame on science's editors for that.

Re: Fake scientific papers are alarmingly common

#92
post #8

The cash cows, AKA Elsevier et al, need to do more to stem the flow of BS. The problem is the proliferation of well crafted, but fake, papers has grown enormously over the past 25 years as the cows rely on free paper editors - who are swamped by this duty = time for paid scientists to winnow the chaff. Sadly the cows are a greedy lot. Only way out is fully open. Back in the day when Nobel was born, the journals and a…

As one who published primarily in the 1970s and 1980s [ https://scholar.google.com/citations?user=5DdrMc8AAAAJ&hl=en ] I can confirm that I mailed reprints of my requested papers to whomever requested them, for free. Note: I paid for the reprints and the postage, often expensive foreign rates.

Ok, but how many citations/yr and reprints/yr did you get? The volume of literature has scaled exponentially since.

Re: Fake scientific papers are alarmingly common

#93
post #48

Earlier quoted context omitted.

Well, there is a difference between "fake science" and "tried to do correct science but ending being wrong". If the second is "fake science", then basically all that Newton has ever produced is "fake science". For the social science journals bit, are you thinking of the "grievance studies affair": https://en.wikipedia.org/wiki/Grievance_studies_affair ? Ironically, this study has generated a lot of "fake news" on the…

There's also a difference between outright fake science i.e. lies/fabricated data in the manuscript and bad science i.e. the conclusions drawn by the authors were always "fake" because of bad practices but if you look at the details of the work they are honest about what they did. Of course ideally you would minimize both types of bad paper, but the latter isn't too damaging to the system in isolation while the forme…

And the first one should be divided further into two categories:

1) committed deceiver that started working in this field for years and that somehow managed to not get caught (pretty rare).

2) fake science articles that get published but has absolutely no impact on scientists because scientists don't progress based on randomly found articles, but by meeting the authors in workshops, exchanging with them, ... which make a one-off fake article with fake author totally irrelevant.

If you are a junior scientist, the articles you read are mainly the ones recommended by senior scientists around you, and if you are a senior scientist, you are part of a community, you know the people who publish, and if you see a random article coming from nowhere, you may read it just in case, but you don't let it mislead you or change significantly your own research just based on reading it.

I think it's a flaw on some lawman people when they discuss "fake articles being published": they don't realize how small "having an article published" impact the field. Presenting it in workshop and debating with colleagues does, but what the layman person has in mind will never maintain the illusion.

Re: Fake scientific papers are alarmingly common

#94

Earlier quoted context omitted.

Thank you for clarifying. The publishers ostensibly occupy a role of stewardship, I suspect the model must have made sense at one point. I admit its hard to see them as much more than rent extractors these days. The nature of trust relationships seems to trend towards aggregation and centralization. Do you have any thoughts on how a web of trust can sustain itself, or is that perhaps not a concern if a centralization…

There's a belief among some distributed systems folk: > If your system doesn't have an explicit hierarchy then it has an implicit one. I think it's hogwash. There are plenty of distributed systems in nature that lack a hierarchy (mycorrhizal networks in the soil of a forest come to mind). Truly distributed systems are possible, we humans are just bad at it. Or rather, we're bad at designing for it. We do it all the t…

That is a really fascinating position, tying it into CAP - damn, I'm going to have to think on this.

Re: Fake scientific papers are alarmingly common

#95
post #27

I am amazed at how well Alexandra Elbakyan has created and promoted sci-hub to fight these journal cash cows, and appalled at the way these journals have tried to block her. They now digitally watermark every journal downloaded at colleges etc, so they can ID the provenance of the journals = she must obfuscate this as best she can. The journals try to punish universities that leak papers to sci-hub Give her a wave...…

https://www.stm-assoc.org/stm-integrity-hub/

Re: Fake scientific papers are alarmingly common

#98
post #9

> Sabel’s tool relies on just two indicators—authors who use private, noninstitutional email addresses, and those who list an affiliation with a hospital. Can someone explain why the affiliation with a hospital is used as a key indicator?

A huge part of the problem is driven by Chinese hospitals. The PRC decided that they wanted China to catch up to the west in science, so made a role that to get promoted as a doctor you have to get some papers published in international journals. That applies to all doctors. But they're, you know, busy doctoring and don't have time out energy to do that. At the same time they'd like to get promoted. So they buy papers.

Re: Fake scientific papers are alarmingly common

#99

Earlier quoted context omitted.

There's a belief among some distributed systems folk: > If your system doesn't have an explicit hierarchy then it has an implicit one. I think it's hogwash. There are plenty of distributed systems in nature that lack a hierarchy (mycorrhizal networks in the soil of a forest come to mind). Truly distributed systems are possible, we humans are just bad at it. Or rather, we're bad at designing for it. We do it all the t…

That is a really fascinating position, tying it into CAP - damn, I'm going to have to think on this.

I've given it a lot of thought, but not much code. I wish I could say that building a proof-of-concept has been difficult, but I'm not even to the difficult part yet, I'm struggling with the boring stuff like time management.

One day I'll have saved enough to take a year off and I'll build that POC.

---

Re CAP, the reason I think that consistency is the problem: It creates high value targets for corruption. Somebody or something has to arbitrate against whatever alternative would threaten consistency. That's a position of power, and too often its one that's easier to retain by abusing that power than by taking your role as arbiter seriously.

The power that comes from being an emergent authority on a topic--where the system arrives at consensus not because its design requires it, but because the thing we're agreeing on really has that much merit--that's a different kind of power. You can't squat on it and abuse it, people will just stop trusting you. The only thing to do with that power is to use it to continue striving towards something worthwhile (the difference being that people are now trying to help you). If this was our model for group coordination, I think we'd end up with leaders of a different temperment.

That's what we should all want for power. It should be hard to get and easy to lose.

Post reply on HN