Earlier quoted context omitted.
I can’t tell if by “dying industry” you mean universities or journal databases.
Honest question: why do commenters here frequently seem to bear a chip on their shoulder when it comes to institutions of higher learning?
If I don't like academia, it's from my experience in academia. Doing good research won't guarantee you a position. On the contrary, what seems to matter is bringing in a lot of money via grants and publishing tons of papers in recognized journals. This better be done steadily too. I know one guy who didn't get tenure at my university, likely because he had a year or two without any publications. Personally, I think a year or two without publications might be necessary for some longer-term projects. So the system has a short-term bias built in too.
You can be a jerk to your students and thrive in this system. (I'm sure other grad students and former grad students can think of copious examples.)
This seems to be because most people, even other researchers, can't evaluate the quality of work in other fields. I'd go farther than that and say that most researchers don't even know what good quality work should look like in their own fields. So instead they look for proxies like the sheer number of papers published, amount of money brought in, impact factor of the journals published in, how a researcher follows trends, etc. But these are weak proxies at best, maybe even anti-correlated with good research.
I'm sure that tenure track positions are great once you have tenure, but it's a lottery at best, and I think the processes of getting a PhD and tenure select for people who are unlikely to take risks, or teach them to avoid riskier research. So if you have tenure, you're less likely to do the sort of bold research I think is so valuable. I would hesitate to call most research even "incremental" as most researchers do a shallow review of their field, so they can't really build on anything. More like "spinning your wheels". If I became a professor and got tenure I'd probably never advance from associate to full professor, as I'd immediately switch my research strategy from "safe" research before tenure to higher impact research after tenure.