Earlier quoted context omitted.
Individual studies shouldn't be the primary focus. It shouldn't fall to every individual researcher to be fully accurate and honest. This is just not possible because people are imperfect, and have all the wrong incentives in many cases. What we need is a system designed to deal with this better. My suggestion would be greater incentives to the publication of negative results, and incentives to reproduce research. Cr…
Peronsally, IMO: you should submit methodology--including the data analysis and statistical tests you'll perform, to a journal before the study has been conducted. Then, they say yes or no and if yes you perform the study and as long as it is performed to the approved specifications, you get published.
Here an example of a typical project, where researchers are interested in the role of gene X in blood vessel formation in cancer, which could make it a good target for a cancer treatment. They want to knock the gene out and measure the blood vessel formation in an in vitro model.
Publication 1.
- We attempted to knock this gene out in this cell line, but due to an infection the cell line died. The installation was sterilized, the stored master cell bank was unfrozen, and we updated our sterilization protocols.
Publication 2.
- We attempted to knock this gene out in this cell line, but sequencing showed that there were off-target effects introduced. Reagents should be changed to be more specific.
Publication 3.
- The gene was succesfully knocked, but we found that a homologous gene appeared to activate the same pathway. The homologous gene should be knocked out as well to study the function of the gene.
Publication 4.
- The gene was successfully knocked out by disabling the gene and its homologue. The assay we used to study blood vessel formation was flawed. Due to insufficient oxygen supply, the positive and negative controls for blood vessel formation did not grow. New experiments should increase oxygen flow.
Publication 5.
- We successfully studied the function of the gene and found that it does not impact blood vessel formation in cell line x.
This is how the majority of research projects end up.
However, other researchers will be looking for a biological target to treat cancer X, and the information obtained by this series of experiments is not interesting. This is just one out of 99% of 30,000 genes that are not suitable treatment targets.
The conclusions are only interesting for researchers focused on gene x (and maybe its homologue), and potentially for researchers developing methodology. Questions answered were different than the original ones posed.