Evidence Based Medicine is one of those things that is a good thing, but was pushed so hard by its proponents that it ended up overemphasizing a particular kind of study as the only real way to know things in medicine.
Yes, absolutely, medicine should be evidence based. Yes, large randomized, double blind, placebo controlled studies provide a lot of information.
However, there are limitations with these kinds of studies.
First, it may not be ethical or practical to study some things in this manner. For example, antibiotics for bacterial pneumonia has not had a randomized, double blind, placebo controlled study.
Famously, there was an article discussing how parachutes in jumping out of airplanes had not been subject to a randomized, double blind, placebo controlled study. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC300808/
Later, somebody did that study: https://www.bmj.com/content/363/bmj.k5094 and found that parachutes made no difference, but it is not applicable to any real world case where you would use a parachute.
Which illustrates the second issue with evidence based medicine. Many times, the large trials's main thing they are measuring are different than what you really want to know, or the population they studied has significant differences from the patient who is right in front of you. How to apply the results of the large study to the individual patient in front of you is still more of an art than a science.
Finally, I think there is the example from machine learning. It has turned out that instead of creating more and more rules, feeding lots and lots of data to a neural network ends up performing better in a lot of machine learning cases. In a similar way, an experienced physician who has treated thousands of patients over decades has a lot of implicit knowledge and patterns stored in their (human) neural networks. Yes, these decisions should be informed by the results of trials, but they should not be discounted, which I think that Evidence Based Medicine did in at least a small part. During my residency, I worked with physicians who would examine and talk with a patient and tell me that something is not right and to do more extensive tests which would end up unearthing a hidden infection or other problem that we were able to treat before it caused major problems. They were seeing subtle patterns from decades of experience that might not even be fully captured in the patient's chart, much less a clinical trial without thousands of participants.
So yes, these clinical trials are a very important base for knowledge. But so is physician judgment and experience.
Source: I am a physician.