> The limiting factor is no longer knowledge. It's the ability to absorb knowledge.
I get your point that from all experiments we performed so far and bothered to write down and digitize there might be few tricks left to squeeze out, but vast majority of our current progress comes from new experiments.
I agree that AI could very well write stuxnet or mess with our security so I'm hoping we get bit more tight in that department before we manage to build AI. I'd definitely prefer first artificial consciousness to be built before robots are as popular as cars or smartphones.
We will eventually develop AI and it'll be definitely challenging to orchestrate it running most of our civilization and not killing us in the process.
What I'm not afraid is AI taking what we know so far and secretly turning itself into miracle making god in matter of weeks. We will have few years or decades of existence before AI becomes vastly more powerful than the rest of us and till then we will have ability to align our priorities.
> Human brains run at maybe 100 hz. AI's built out of silicone could work thousands of times faster. Doing the same work, just in much shorter time.
It's not work. It's just thinking. AI can create philosophical theories or build new optimal JavaScript frameworks at blazing speed and still not make any progress in physics that would make it more powerful than us. It needs new data. It needs to run experiments to get anywhere beyond what we achieved so far. If we maintain transparency and caution in what AI is given and allowed to do then we may have safely transition from current world to AI world. Besides, at some point our civilization will encounter others it's better to bring our own AI to the table. Alien one might attach much less sentimental value to us.
> If you went back in time to Blaise Pascal, if you took the right books and plans from the future, you could get them to CPUs in mere years.
No, you couldn't. Do you know how long it takes to build a fab with current infrastructure available? You'd have to bring half or their industry into XX century before you could have a CPU.
> If you can predict prices 1% more accurately than anyone else, then you can make a huge amount of money in the long run.
Yes. The thing with stock market is that you can't. It's not because you are not smarter than other traders. It's because interaction between all the traders creates pretty much perfect chaotic random process that no-one can predict.
> Stock prices aren't random. They are determined by real events, mainly how much profit the company makes.
Same way random generator driven by unknown algorithm is predicted by its seed.