Does this give anyone else the sense that with amazing processors we have available that we're being really wasteful with these bloated apps we currently have? I mean if these guys are able to do this in 4K, what else could be done in operating system terms if we achieved that same level of excellence?
These demos rely on the OS to access sound & graphics, they could not reach the fidelity they do without the OS hiding away much of the file size. You could not do a 4K demo if you had to include the infrastructure to load a modern graphics driver & OpenGL/DX libraries. They are also only small in terms of package size. This demo for example uses about 550MB of RAM while running(Win7x64).
Once your program started executing you were on your own, graphics, sound, memory management, everything. People still managed to get the first level of descent into 4K.