> these days, few people want specialized computers for artificial intelligence, preferring powerful general-purpose machines like those made by Sun Microsystems Inc., a fast-growing Silicon Valley company. This is a starking example of how tech cycles change over time. The period in which the article was written was during an AI Winter (in fact, the Fifth Generation program is listed as a notable example[1] in the W…
But looking back over the last 20 years, at least for the silicon paradigm, I think we may finally be in the last turn of the wheel. The trend back towards specialized hardware (for audio, video, encryption, NN, servers vs smartphones) seems fairly inexorable. There's no CPU architecture remotely on the horizon which is general and blows away everything else for flexibility and speed. Even specialized hardware like GPUs are starting to see their lunch eaten by ultra-specialized ASICs and TPUs.