Earlier quoted context omitted.
> My guess would be that this new version relies more heavily on pro games. Unlikely, since AlphaGo can now generate large numbers of "pro quality" games from scratch. I think it's far more likely it is an autodidact at this point.
They solved heads up poker in this manner recently. They claim that the chances anyone can beat this computer in the long run are now infinitesimal. http://poker.srv.ualberta.ca/about
Google reveals secret test of AI bot to beat top Go players
61–70 of 214 posts
Re: Google reveals secret test of AI bot to beat top Go players
#62One thing that isn't made clear in this writeup is that Master plays in a very nonhuman style, as opposed to the version of AlphaGo that beat Lee Sedol, which mostly played like a strong human except for a few surprising moves. My first guess when I saw Master's games was that it was a program like AlphaGo that had its policy network trained from scratch rather than being bootstrapped by being given the goal of imita…
> I would not have guessed that human strategy was that deficient. With as much freedom as Go allows I think it would be surprising if humans had stumbled upon an optimal strategy (or Master for that matter, I'm sure there is still much to be improved!).
Re: Google reveals secret test of AI bot to beat top Go players
#63Earlier quoted context omitted.
Human moves tend to fit a narrative and be explainable, although often for very concrete reasons. For example: "I am sketching out territory while attacking an opponent group." "I am making my group safe so that I will not have to worry about its life while I accomplish other strategic goals." "I am making a very strong group so that I can use it to make it harder for my opponent to accomplish anything." Master, on t…
> Human moves tend to fit a narrative and be explainable, although often for very concrete reasons. I'm not a Go player, but could it not be that if the AI played its moved in a more human order you could see what was going on and assign a narrative to the moves, but the AI can see the order of the moves doesn't matter sometimes so it seems to play more vaguely/randomly to observers? For example, say the AI played a…
Re: Google reveals secret test of AI bot to beat top Go players
#64Earlier quoted context omitted.
I don't know much about Go but I thought a comment about AlphaGo was interesting that it played in a way to marginally beat the player, which was different that most masters played, which is to clearly beat the opponent by as wide a margin as possible. Is this accurate? Does MasterP also use this style? Are there humans that can play this way? (I'm asking you because you seem to know what you are talking about here.)
I think this is somewhat incorrect- The creators of AlphaGo made it clear that their system does not take the opponent into account at all, it just answers the question "What is the strongest move right now?" and plays that move, without taking the opponent into account. In other words, it does not have any mental model of the opponent. However, you are correct insofar that it doesn't care about winning by large marg…
Re: Google reveals secret test of AI bot to beat top Go players
#65This seems like the beginnings of the plot of an anime I'd want to watch. Season two would probably start with the developer's getting complacent and a Chinese AI entering the scene.
Really hope to see one machine against another. In future we'd probably have game tournament of AI machines. Example my tensorflow-build machine against your openai-build machine in a StarCraft game.
Re: Google reveals secret test of AI bot to beat top Go players
#66Re: Google reveals secret test of AI bot to beat top Go players
#67Earlier quoted context omitted.
Yes but players are usually presented by their rank, e.g: Ke Jie 9P, Lee Sedol 9P. Then, professional dans in some Go associations are granted by total wins over their career rather than relative strength to another rank (e.g: Japan).
There is already a wide range of strength among 9p players. In addition, once a player reaches 9p, they never lose it, so it includes players in their prime as well as players who have declined.
http://senseis.xmp.net/?NihonKiInNewPromotionSystem
Fernando Aguilar, a 6 dan amateur from Argentina (http://senseis.xmp.net/?FernandoAguilar) defeated 2 Nihon Kiin 9 professional dans (Hasegawa Sunao and Yo Kagen), which is unexpected given the substantial rank difference.
Re: Google reveals secret test of AI bot to beat top Go players
#68Earlier quoted context omitted.
The version that beat Lee Sedol was trained on pro games.
Their Nature paper says "We trained the policy network p_sigma to classify positions according to expert moves played in the KGS data set. This data set contains 29.4 million positions from 160,000 games played by KGS 6 to 9 dan human players; 35.4% of the games are handicap games." It is possible that they fed it some pro games after the Fan Hui games but before the Lee Sedol games, but that would be weird; at that…
I'm confused. I thought 9-dan players were considered pro? That's the highest ranking you can get, right?
Re: Google reveals secret test of AI bot to beat top Go players
#69Earlier quoted context omitted.
Their Nature paper says "We trained the policy network p_sigma to classify positions according to expert moves played in the KGS data set. This data set contains 29.4 million positions from 160,000 games played by KGS 6 to 9 dan human players; 35.4% of the games are handicap games." It is possible that they fed it some pro games after the Fan Hui games but before the Lee Sedol games, but that would be weird; at that…
> games played by KGS 6 to 9 dan human players I'm confused. I thought 9-dan players were considered pro? That's the highest ranking you can get, right?
Re: Google reveals secret test of AI bot to beat top Go players
#70One thing that isn't made clear in this writeup is that Master plays in a very nonhuman style, as opposed to the version of AlphaGo that beat Lee Sedol, which mostly played like a strong human except for a few surprising moves. My first guess when I saw Master's games was that it was a program like AlphaGo that had its policy network trained from scratch rather than being bootstrapped by being given the goal of imita…