This is basically the thesis of Paul Feyerabend who used it as his main argument against there being a scientific method. His book "Against Method" is one of the best works on Philosophy of Science I've read during my university education.
For quite a while I've suspected that you might be able to support Feyerabend's argument using modern learning theory. In particular I suspect that this is relevant: https://en.wikipedia.org/wiki/No_free_lunch_in_search_and_op... Science is essentially a learning process. Since every learning method has a performance envelope and fares better against some fitness landscapes than others, restricting science to a singu…
Science is a testing process which we engage in to learn. Minor, but critical difference.
> a single scientific method
"Hypothesize and test." That's it, there is only one.
Now, which strategy do you use to pick the best hypothesis, and to test faster, etc? That's the part you don't want to get dogmatic about. (eg gradient descent.)