What is it that's being programmed?
Commodore 64 programmers were never interested in "Bayesian Statistics" and "Digital Signal Processing". Their main interest was pretty much related to systems programming in one way or another.
Today's "programmers" expect to do crazy things like carry out statistical analysis on megabytes of data, in a matter of minutes, with all kinds of insightful plots, and animations and what not. (Same goes with DSP).
Today's programmers are NOT asking for what Commodore 64 programmers were asking for. They're asking for way way more.
Not that there is anything wrong with that. But who's is to provide such shiny interfaces to future Bayesian-statisticians and Digital-signal-processors?
- System programmers do massive research to automate for today's programming demands, workflows, and activities. And a lot of people are working in this space. But it's full of information overload without a clear winner.
- Or one of their own takes a hit for the team, transitions into system level programming, and uses his past experience to create usable interfaces, processes, workflows, and associated software. It's not an easy task.
I think now we're talking about something I've been struggling with for many years, a computational science workflow software. Again there are hundreds of projects in this space but that makes it even worse. How do you chose between them? Someone says he/she uses Sumatra and it works for him/her. But it may not work for someone else. Someone else says you should follow Cookiesutter Data Science guidelines. But that's also addresses on a small aspect of the overall problem. Etc, etc. The there are the emacs diehards who claim you can do everything in emacs so why leave emacs. Well I can do everything in linux + shell + C so why leave linux + shell + C? (point being emacs only let's you do everything by becoming an OS in itself).
I don't have a solution.
I'm working on this problem in my spare time from a very very different meta level angle. But that is a massive research project and cannot be finished in a matter of a couple years, much less without funding.