Earlier quoted context omitted.
> and applying Moore's law, it will take about 60 years before we can simulate a brain in real time with a single machine. What Moore's law? This has already stopped.
Re Moore's law, the best answer I could get was from Intel via Wikipedia[0] "our cadence today is closer to two and a half years than two." So I wouldn't call that "stopped" but slowed. On the other hand, there are other kinds of advancement that don't really fit into any kind of "law" but might make up for this slowdown, resulting in long term exponential growth, e.g. the transition from CPU to GPU computing. [0] ht…
So this "2.5 years" is just the first slowdown -- it gets worse. It's not like we just change 2 to 2.5 and continue for the next 10-20 years.
Probably not even 2 or 3. After 10nm, which is already challenging, you're basically screwed with any kind of process known/used today. And the costs for a fab are into the billions (and get higher with lower sizes), so it's not like small players can even compete in that field.
And that's for multicore -- so unless we also get a way to write more programs to be massively parallel (which lots of algorithms cannot be made) -- we don't get the "free boost" from Moore's law with regards to speed that we used to get.
Not only it's dropped to 2.5 years, but it's also more useless, just giving us more transistors in not readily usable cores.
That's why Intel devotes large part of the CPU to the embedded GPU -- it doesn't have much else to do with it.