My (long) commentary here: https://www.facebook.com/yudkowsky/posts/10154018209759228 Sample: At this point it seems likely that Sedol is actually far outclassed by a superhuman player. The suspicion is that since AlphaGo plays purely for probability of long-term victory rather than playing for points, the fight against Sedol generates boards that can falsely appear to a human to be balanced even as Sedol's probabili…
We put a man on the moon, which encouraged decades of optimism about the near-future colonization of space... unfortunately it turns out we are nowhere near solving the hard problems associated with being able to live in space.
We spelled out the letters IBM in xenon atoms, five atoms tall, which encouraged optimism about near-future molecular manufacturing... unfortunately it turns out we are nowhere near solving the hard problems associated with making useful things with atomic precision.
We achieve superhuman performance in simple games, which encourages what should be optimism that becomes reflected by the distorting mirror of the zeitgeist of the times into pessimism, about near-future AI... unfortunately it turns out we are nowhere near solving the hard problems associated with making our tools something better than depressingly dumb.
In each case, the flurry of optimism turns as the decades pass into confusion, anger, soul-searching about why the expected follow-on progress has failed to materialize, fading slowly into despair, then into nothing as the optimists die of old age, one by one, and the rate of technological progress becomes slower with every passing decade. For this conversation is necessarily happening at a tech level that allows it, but that provides no guarantee whatsoever that the species that reached tech level X will proceed to tech level X+1. Moore's law has officially expired, and that was the last major area where we were making rapid sustained progress.
It's hard to say we shouldn't do 'flag and footprints' demonstrations; am I really willing to bite the bullet and say we shouldn't have put a man on the moon? I don't know the answer to that. I am, however, convinced that we should remember not to take them too seriously.