Argh. From the article:
> The fears of machine superintelligence are based on the belief that true AI is just around a corner. After all, we’re so advanced and the progress is only accelerating, it’s probably a few years away, at most.
Versus MIRI [1], quoting Nick Bostrom, whose book is arguably what most recently sparked all of the current discussion of AI risk:
> If what readers take away from language like “impending” and “soon” is that Bostrom is unusually confident that AGI will come early, or that Bostrom is confident we’ll build a general AI this century, then they’ll be getting the situation exactly backwards.
> [...]
> > My own view is that the median numbers reported in the expert survey do not have enough probability mass on later arrival dates. A 10% probability of HLMI [human-level machine intelligence] not having been developed by 2075 or even 2100 (after conditionalizing on “human scientific activity continuing without major negative disruption”) seems too low.
> > Historically, AI researchers have not had a strong record of being able to predict the rate of advances in their own field or the shape that such advances would take. On the one hand, some tasks, like chess playing, turned out to be achievable by means of surprisingly simple programs; and naysayers who claimed that machines would “never” be able to do this or that have repeatedly been proven wrong. On the other hand, the more typical errors among practitioners have been to underestimate the difficulties of getting a system to perform robustly on real-world tasks, and to overestimate the advantages of their own particular pet project or technique.
I agree with the meat of the article, though – recent AI progress has surely been oversold by the media. It's really frustrating to see people continually arguing against strawmen when there are some perfectly lovely arguments to grapple with instead!
Aside: is there some kind of law we could coin that if a rebuttal to AI risk starts off by referencing Skynet and Terminator, we can safely assume it's not going to be worth reading?
[1] https://intelligence.org/2015/01/08/brooks-searle-agi-voliti...