Live data from Hacker News

Google reveals secret test of AI bot to beat top Go players

nature.com

61–70 of 214 posts

Re: Google reveals secret test of AI bot to beat top Go players

#61
post #53
post #35

Earlier quoted context omitted.

> My guess would be that this new version relies more heavily on pro games. Unlikely, since AlphaGo can now generate large numbers of "pro quality" games from scratch. I think it's far more likely it is an autodidact at this point.

They solved heads up poker in this manner recently. They claim that the chances anyone can beat this computer in the long run are now infinitesimal. http://poker.srv.ualberta.ca/about

Still a good way to go to beat no limit holdem I'd assume.

Re: Google reveals secret test of AI bot to beat top Go players

#62
post #12
post #7

One thing that isn't made clear in this writeup is that Master plays in a very nonhuman style, as opposed to the version of AlphaGo that beat Lee Sedol, which mostly played like a strong human except for a few surprising moves. My first guess when I saw Master's games was that it was a program like AlphaGo that had its policy network trained from scratch rather than being bootstrapped by being given the goal of imita…

> I would not have guessed that human strategy was that deficient. With as much freedom as Go allows I think it would be surprising if humans had stumbled upon an optimal strategy (or Master for that matter, I'm sure there is still much to be improved!).

The fact that Go commentators talk in terms of local strategy and narrative and anything other than the end-game from the very beginning made me feel fairly confident that Go was not a game that humans would ever reach optimal strategy levels at.

Re: Google reveals secret test of AI bot to beat top Go players

#63
post #13

Earlier quoted context omitted.

Human moves tend to fit a narrative and be explainable, although often for very concrete reasons. For example: "I am sketching out territory while attacking an opponent group." "I am making my group safe so that I will not have to worry about its life while I accomplish other strategic goals." "I am making a very strong group so that I can use it to make it harder for my opponent to accomplish anything." Master, on t…

> Human moves tend to fit a narrative and be explainable, although often for very concrete reasons. I'm not a Go player, but could it not be that if the AI played its moved in a more human order you could see what was going on and assign a narrative to the moves, but the AI can see the order of the moves doesn't matter sometimes so it seems to play more vaguely/randomly to observers? For example, say the AI played a…

Made me think of this: [https://www.youtube.com/watch?v=fU7hZ3smj0g&t=4m22s](https:/...

Re: Google reveals secret test of AI bot to beat top Go players

#64
post #33
post #21

Earlier quoted context omitted.

I don't know much about Go but I thought a comment about AlphaGo was interesting that it played in a way to marginally beat the player, which was different that most masters played, which is to clearly beat the opponent by as wide a margin as possible. Is this accurate? Does MasterP also use this style? Are there humans that can play this way? (I'm asking you because you seem to know what you are talking about here.)

I think this is somewhat incorrect- The creators of AlphaGo made it clear that their system does not take the opponent into account at all, it just answers the question "What is the strongest move right now?" and plays that move, without taking the opponent into account. In other words, it does not have any mental model of the opponent. However, you are correct insofar that it doesn't care about winning by large marg…

A perhaps more accurate way to say it is that AlphaGo's models its opponents as a copy of itself.

Re: Google reveals secret test of AI bot to beat top Go players

#65
post #24
post #8

This seems like the beginnings of the plot of an anime I'd want to watch. Season two would probably start with the developer's getting complacent and a Chinese AI entering the scene.

Really hope to see one machine against another. In future we'd probably have game tournament of AI machines. Example my tensorflow-build machine against your openai-build machine in a StarCraft game.

Sounds like RoboCode.

Re: Google reveals secret test of AI bot to beat top Go players

#67

Earlier quoted context omitted.

Yes but players are usually presented by their rank, e.g: Ke Jie 9P, Lee Sedol 9P. Then, professional dans in some Go associations are granted by total wins over their career rather than relative strength to another rank (e.g: Japan).

There is already a wide range of strength among 9p players. In addition, once a player reaches 9p, they never lose it, so it includes players in their prime as well as players who have declined.

Yes, the ranking system you refer to is the one based on total wins over a player career and doesn't consider loses like ELO or other rating systems do.

http://senseis.xmp.net/?NihonKiInNewPromotionSystem

Fernando Aguilar, a 6 dan amateur from Argentina (http://senseis.xmp.net/?FernandoAguilar) defeated 2 Nihon Kiin 9 professional dans (Hasegawa Sunao and Yo Kagen), which is unexpected given the substantial rank difference.

Re: Google reveals secret test of AI bot to beat top Go players

#68
post #43
post #31

Earlier quoted context omitted.

The version that beat Lee Sedol was trained on pro games.

Their Nature paper says "We trained the policy network p_sigma to classify positions according to expert moves played in the KGS data set. This data set contains 29.4 million positions from 160,000 games played by KGS 6 to 9 dan human players; 35.4% of the games are handicap games." It is possible that they fed it some pro games after the Fan Hui games but before the Lee Sedol games, but that would be weird; at that…

> games played by KGS 6 to 9 dan human players

I'm confused. I thought 9-dan players were considered pro? That's the highest ranking you can get, right?

Re: Google reveals secret test of AI bot to beat top Go players

#69
post #68
post #43

Earlier quoted context omitted.

Their Nature paper says "We trained the policy network p_sigma to classify positions according to expert moves played in the KGS data set. This data set contains 29.4 million positions from 160,000 games played by KGS 6 to 9 dan human players; 35.4% of the games are handicap games." It is possible that they fed it some pro games after the Fan Hui games but before the Lee Sedol games, but that would be weird; at that…

> games played by KGS 6 to 9 dan human players I'm confused. I thought 9-dan players were considered pro? That's the highest ranking you can get, right?

I think those servers have their own ranking system that does not match the "official" rankings (which I think cap amateurs at some lower dan rank)

Re: Google reveals secret test of AI bot to beat top Go players

#70
post #7

One thing that isn't made clear in this writeup is that Master plays in a very nonhuman style, as opposed to the version of AlphaGo that beat Lee Sedol, which mostly played like a strong human except for a few surprising moves. My first guess when I saw Master's games was that it was a program like AlphaGo that had its policy network trained from scratch rather than being bootstrapped by being given the goal of imita…

Since AlphaGo's original training was to predict human moves, it should know how surprising a move is in addition to knowing how strong it is. My thought at the time was it could improve its game against humans by giving surprise value some weight -- when it can pick a slightly weaker but highly surprising move, pick the surprise.
Post reply on HN