Live data from Hacker News

Go grandmaster Shin defeats AI KataGo with a two-stone handicap

kedglobal.com

21–30 of 184 posts

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#21
post #10

Earlier quoted context omitted.

Yes, so calling it a "defeat" is improper to me.

The headline is misleading, but this is still huge. 2 stones against katago is insane, I'd never have guessed we'd see that, ever.

Annoyingly misleading. I read it that the human player was handicapped.

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#22
For all four of you that are like me and understand Dota 2 a lot better than Go, and are wondering what impact a “two-stone handicap” has and what it means, ChatGPT Pro claims that to analogize this scenario to a professional team playing against OpenAI Five:

> The professional human team begins from a legal eight-to-ten-minute game state in which it has decisively won the laning stage: roughly a 6,000–8,000 team-net-worth lead, a 4,000–6,000 team-XP lead, two enemy Tier 1 towers destroyed, the third badly damaged, and all three friendly Tier 1 towers standing.

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#23
> "This series taught me that rather than trying to imitate AI, it is far more important to build the board according to my own style."

It's never made sense to me that so many go players study AI go play in the hope of emulating it in a human game. We're not machines. We can't do thousands of Monte Carlo tree searches per second.

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#24
post #5

It’s worth understanding that Shin Jinse has been significantly stronger than his nearest human opponents for a while now, more so than Magnus was even at his very peak. In go ELO like scoring he’s something like 120 points over the next strongest player. No other player has ever broken a 3800 rating let alone 3850. Ke Jie (the previous long time champion) peaked at 3755. Shin Jinseo’s strength graph is the most absu…

Important to note that KataGo was double-handicapped. 20 seconds per move maximum; it couldn’t read deep. Against an amateur, it doesn’t matter, but against a historically strong pro it matters a lot.

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#26
post #15

Earlier quoted context omitted.

For a non-Go player, do you think this trend will persist, or is it more of a dead-cat/human bounce?

On one hand, Shin Jinseo is an outlier player of this generation. On the other hand, the newest generation of new pros will have exclusively learned by using the AI to tell them what the best move is, so there's reason to believe that peak human level has yet to be reached.

Distillation of our blessed models is no fair!

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#27

KataGo isn't very good at exploiting weaker opponents. In chess people were convinced a grandmaster can never be beaten with a knight odds. It's just too easy to simplify the position and win. It was very easy (for a grandmaster) vs already super human Stockfish. It was still kinda easy (for a strong GM) vs 200+ ELO stronger NNUE Stockfish. And then someone made a net optimized for exploiting humans. Its games are am…

can the grandmasters still win with rook odds?

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#28
post #14
post #9

Earlier quoted context omitted.

> Also, the human played a strategy tailored to that huge initial advantage. He said that the AI did not handle this particularly well, and played high probability moves instead of trying to lure him into a mistake. Yeah, katago's training is not really focused at all on handicap games, because it's by nature learning from even games against similar-strength opponents. It doesn't have specific training from playing i…

While AlphaGo originally only had win rate as a metric, modern Go AIs have more knobs, including an evaluation of "complexity". Just stating this off the top of my head so I could be misremembering, but I heard that the KataGo settings used were tweaked to favor complexity. This was most apparent in Game 1 which Shin Jinseo lost, where the AI had an unusual opening. However, the last game was quite plain leading me t…

Ah this is interesting. Essentially the idea is that the compute can try and move into positions that it can evaluate but humans might have trouble evaluating because of the board state's complexity?

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#29
post #5

It’s worth understanding that Shin Jinse has been significantly stronger than his nearest human opponents for a while now, more so than Magnus was even at his very peak. In go ELO like scoring he’s something like 120 points over the next strongest player. No other player has ever broken a 3800 rating let alone 3850. Ke Jie (the previous long time champion) peaked at 3755. Shin Jinseo’s strength graph is the most absu…

I don't think it's solely a matter of raw strength, but as Shin said, a willingness not to play to the program's strengths. I mean, one thing that rankled me about original Lee Sedol match was that Lee had no access to the program's "record" while the machine by the nature of the AI training process had effectively studied Lee's games in great detail.

I recall a while back someone came up with a set of "anti-computer" strategies that allowed even an amateur to defeat a strong go program. These moves weren't anything like ordinary go moves (and perhaps the "loophole" has been closed now) but imo, their existence suggests that a study of programs may reveal other unexpected weakness.

Re: Go grandmaster Shin defeats AI KataGo with a two-stone handicap

#30
post #5

It’s worth understanding that Shin Jinse has been significantly stronger than his nearest human opponents for a while now, more so than Magnus was even at his very peak. In go ELO like scoring he’s something like 120 points over the next strongest player. No other player has ever broken a 3800 rating let alone 3850. Ke Jie (the previous long time champion) peaked at 3755. Shin Jinseo’s strength graph is the most absu…

Probably a better comparison from the chess world(in reasonably modern times, though perhaps players like Capablanca and Lasker could be mentioned as well. Alas, I don't think FIDE rating existed back then) is Bobby Fischer. In the july 1972 FIDE rating list he held a rating of 2785, the highest in history at the time, with Spassky in second sitting at a "measly" 2660, and only 13 players being above 2600 even.
Post reply on HN