Live data from Hacker News

Government grant-funded research should not be published in for-profit journals

experimental-history.com

11–20 of 154 posts

Re: Government grant-funded research should not be published in for-profit journals

#11
post #3

I have had so many "why don't you just" conversations with academics about this. I know the "why don't you just" guy is such an annoying person to talk to, but I still don't really understand why they don't just. This article pointed to a few cases where people tried to do the thing, i.e. the pledge taken by individual researchers, and the requirements placed by certain funding channels, and those sound like a solid…

I think the call for top-down policy makes sense b/c otherwise this is like every other tragedy of the commons situation. Each of those top-level researchers also has to think, "my department has junior faculty trying to build their publications list for tenure, we have post-docs and grad-students trying to get a high-impact publication to help them land a faculty job, we have research program X which is kind of in a race with a program at that other school lower down in the top 20. If we close off opportunities with the top journals, we put all of those at a competitive disadvantage."

Re: Government grant-funded research should not be published in for-profit journals

#12
post #3

I have had so many "why don't you just" conversations with academics about this. I know the "why don't you just" guy is such an annoying person to talk to, but I still don't really understand why they don't just. This article pointed to a few cases where people tried to do the thing, i.e. the pledge taken by individual researchers, and the requirements placed by certain funding channels, and those sound like a solid…

> If you're an influential figure at a top-5 department in your field ... you all hate $journal.

That's the problem, they don't hate these journals, they love them. Generally speaking they're old people who became influential by publishing in these journals. Their reputation and influence was built on a pile of Science and Nature papers. Their presentations all include prominent text indicating which figures came from luxury journals. If Science and Nature lose their prestige so do they (or at least that's what they think)

This was very apparent when eLife changed their publishing model. Their was a big outpouring of rage from older scientists who had published in eLife when it was a more standard "high impact" journal. Lots of "you're ruining your reputation and therefore mine".

Re: Government grant-funded research should not be published in for-profit journals

#13
post #10

We already have open-access publications: Just put it on arXiV. Most researchers I work with do this already. The problem isn't access, it's citations. arXiV is not considered a credible citation source since anyone can publish anything. TPCs don't use it in their list of citations, neither do grant funding agencies or government institutions. The current academic enterprise relies heavily on third-party gatekeeping.…

Exactly. The solution already exists. However another problem is that the arxiv is creeping towards the old model ...

Re: Government grant-funded research should not be published in for-profit journals

#14
The other factor preventing a fix is that people with no actual serious experience of academic publishing and peer review will defend these journals, because they still think that (journal-based) peer review acts like some kind of meaningful quality filter. But, it really doesn't.

Because someone is surely going to try to defend journals via peer review in this thread, I want to provide a counter to the arguments that journal peer review does much good. Also, since everyone knows that if you just go to a poor enough journal, you can be published, I am going to focus on the (IMO mostly false) claim that higher-profile journals are still doing a good thing here.

There are numerous studies showing that higher-profile journals in general have more retractions and research misconduct [1-2], lower research quality [3], in fact weaker statistical power and reliability [4], and that statistical reliability even in high prestige journals is still extremely poor overall [5]. Also, making it through peer review is highly random and dependent on who you get as a reviewer [6], or is just basically a coin toss even when looking at reviewer groups:

    In 2014, 49.5% of the papers accepted by the first committee were rejected by the second (with a fairly wide confidence interval as the experiment included only 116 papers).  This year, this number was 50.6%.  We can also look at the probability that a randomly chosen rejected paper would have been accepted if it were re-reviewed.  This number was 14.9% this year, compared to 17.5% in 2014. [7]
We should just move to arXiv-like approaches and allow the scientific community to broadly judge relevance and quality. Journals just slow things down and burn funding for very little gain or benefit to anyone other than the journal owners.

[1] https://pmc.ncbi.nlm.nih.gov/articles/PMC3187237/

[2] https://www.pnas.org/doi/10.1073/pnas.1212247109

[3] https://pmc.ncbi.nlm.nih.gov/articles/PMC9382220/

[4] https://journals.plos.org/plosbiology/article?id=10.1371%2Fj...

[5] https://www.frontiersin.org/journals/human-neuroscience/arti...

[6] https://journals.plos.org/plosone/article?id=10.1371%2Fjourn...

[7] https://blog.neurips.cc/2021/12/08/the-neurips-2021-consiste...

Re: Government grant-funded research should not be published in for-profit journals

#16
post #4

Part of the problem is we got tricked into thinking "peer reviewed" meant "true," or at least something like it. It doesn't. Not even close. Peer review doesn't even mean that it's free from errors, free from fraud, free from methodological mischief; it doesn't mean anything at this point. Yet we continue to act like it does. Darwin's work wasn't peer reviewed. Nor Einstein's. It's something we cooked up in the mid 1…

> Darwin's work wasn't peer reviewed. Nor Einstein's

Except it was…? This is absurdly ahistorical and the fact that you cross disciplines in trying to make an incorrect argument questions whether you are in science at all.

The structure of peer review in Darwin’s time was different, where experts wrote monographs and gave lectures at symposia that then led to letters among their peers. Which is what happens now, if you take a step back.

The volume of new work these days is incompatible with the older informal system, and is in some ways our new paradigm is superior as there is a formal period in which new works are reviewed.

Re: Government grant-funded research should not be published in for-profit journals

#17
I absolutely hate this style.

If you're going to write an article titled "The one science reform we can all agree on, but we're too cowardly to do" and that one thing isn't explicitly stated in the first paragraph, I'm out.

Stop with the meandering nonsense and make your argument.

Re: Government grant-funded research should not be published in for-profit journals

#18
post #4

Part of the problem is we got tricked into thinking "peer reviewed" meant "true," or at least something like it. It doesn't. Not even close. Peer review doesn't even mean that it's free from errors, free from fraud, free from methodological mischief; it doesn't mean anything at this point. Yet we continue to act like it does. Darwin's work wasn't peer reviewed. Nor Einstein's. It's something we cooked up in the mid 1…

> Part of the problem is we got tricked into thinking "peer reviewed" meant "true," or at least something like it.

No actual working scientist thinks this.

“Glitchc” has it right elsewhere in this thread: the motivating force behind journals is prominence and reputation, not truth.

Re: Government grant-funded research should not be published in for-profit journals

#19
post #4

Part of the problem is we got tricked into thinking "peer reviewed" meant "true," or at least something like it. It doesn't. Not even close. Peer review doesn't even mean that it's free from errors, free from fraud, free from methodological mischief; it doesn't mean anything at this point. Yet we continue to act like it does. Darwin's work wasn't peer reviewed. Nor Einstein's. It's something we cooked up in the mid 1…

Don't know why you are being downvoted, you are largely correct. I've provided plenty of evidence in another post in this thread showing that journal-based peer review is highly farcical.

EDIT: I still want review from a community of scientific peers. I just don't want this review to be in the hands of a tiny number of gatekeepers entangled with journals that largely just slow things down.

Re: Government grant-funded research should not be published in for-profit journals

#20
post #3

I have had so many "why don't you just" conversations with academics about this. I know the "why don't you just" guy is such an annoying person to talk to, but I still don't really understand why they don't just. This article pointed to a few cases where people tried to do the thing, i.e. the pledge taken by individual researchers, and the requirements placed by certain funding channels, and those sound like a solid…

For the grad students especially, there’d be a career advancement incentive to still publish in the top journals. The professors might still want to publish in them just out of familiarity (with a little career incentive as well, although less pronounced than the grad students).

I think it’d be a big ask from someone whose role doesn’t typically cover that sort of decision.

Post reply on HN