The idea that a field can be reformed by making it worse until it suddenly faces a reckoning and emerges much better is ... I don't know where people keep getting the idea that this might work. It has never worked in any field ever in history. The thing that can happen: fields gradually split into rigorous and non-rigorous camps. Like with evidence-based medicine, or chemistry/alchemy. Depending on the field, either…
Well, I wonder if this could force people to start publishing their code so others can replicate the results. This would help greatly with the kinds of issues that are being discussed: - It would be much harder to hide makeup results and cherry-picked seeds - Useless research would not be as easy to hide - The real-world impact of the research would be more valued. - Researchers would be forced to recheck their code…
This is par for the course in theoretical work; we should strive to apply the same standards of rigor to experimental work.