Earlier quoted context omitted.
I think... Maybe... I'm getting it. Kind of. Probably not. By wiring the CPU directly to the RAM, to use your metaphor, then we can entirely bypass the ASM stage of "a program" (but then what is a program if not a sequence of instructions?) and therefore we may better predict which data our program needs at runtime? Thereby caching that data more effectively than the random access patterns of Von Neumann? Basically,…
Nope, still missing it. When you wire the RAM to the CPU you don't need a cache. Imagine you have a billion or even a trillion registers, or more. That's a non-Von Neumann architecture. You're not shuffling data around on buses, the data is directly connected to the CPU. Look at the example I gave again. Consider a simple addition command. The first CPU instruction says "take the word at this memory address, and move…
If you have a bunch of memory directly on the CPU, caching will still give significant speedups.