Live data from Hacker News

How Much Science Is Fake?

osf.io

81–82 of 82 posts

Re: How Much Science Is Fake?

#81

Earlier quoted context omitted.

This is a problem with the journalism and politics, it's not really about science. No scientist would trust a result that depends on a single small sample paper. Those are just stepping stones that may justify further research for more robust evidence. This fact is quite clear to scientist and it's why most would discourage the general public (including smart engineers) from reading academic articles. But in general,…

> No scientist would trust a result that depends on a single small sample paper. Unfortunately, they would. There are papers with thousands of citations that don't even have data samples, just models based on assumptions.

Citations alone doesn't indicate how it is used.

Maybe a lot of scientist really liked the proposed 'model' and/or some discussion on the assumptions.

and cited it in their paper proposing some additions or follow on work.

That is also fine.

Re: How Much Science Is Fake?

#82

Earlier quoted context omitted.

> No scientist would trust a result that depends on a single small sample paper. Unfortunately, they would. There are papers with thousands of citations that don't even have data samples, just models based on assumptions.

Citations alone doesn't indicate how it is used. Maybe a lot of scientist really liked the proposed 'model' and/or some discussion on the assumptions. and cited it in their paper proposing some additions or follow on work. That is also fine.

When I checked how people were citing these useless papers, almost invariably it would be in a sentence like this:

"Computational modelling is a useful technique for predicting the course of epidemics [1][2][3][4][5]"

The cited papers wouldn't actually support the statement because they'd all be unvalidated models, but citing documents that don't support the claim is super common and doesn't seem to bother anyone :( Having demonstrated a "consensus" that publishing unvalidated simulations is "useful", they would then go ahead and do another one, which would then be cited in the same way ad infinitum.

Post reply on HN