Earlier quoted context omitted.
This is hard to evaluate. Explicit metrics would be good, but there's also a definitional point. Depending on who you ask, existing AI programs are as good as a very strong human player. Others will scoff at that characterization. The problem is what "very strong" means. Precisely, current programs can beat many professionals with a 4 stone handicap. Making good analogies is hard, but here's mine: current go programs…
But, surely, they are going to improve the system, and fast. I would bet that in a few years is going to be clear who is superior, the machine or the human.
I guess Facebook is claiming they're upending that, but that remains to be seen.