Live data from Hacker News

No limit: AI poker bot is first to beat professionals at multiplayer game

nature.com

51–60 of 407 posts

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#51

I'm one of the authors of the bot, AMA

Any chance of the code being released or a cepheus style answer key being provided? http://poker.srv.ualberta.ca/strategy

I don't think the poker world would be happy with us if we did that. Heads-up limit hold'em isn't really played professionally anymore, but six-player no-limit hold'em is very popular.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#52

I'm one of the authors of the bot, AMA

Knowing when to bluff often depends on the psychology of the opponent, but since it trained playing itself it doesn't seem that knowing when to bluff would be learned. Did it bluff very often?

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#53

I'm one of the authors of the bot, AMA

How do you think these same pros would do in a follow-up match? As described in the article, the bot put players off their game with much more varied betting and with donks. Do you think the margin would decrease as players are exposed to these strategies?

Players face mental fatigue and have so over-learned their existing strategies that it takes time to adapt new strategies and even more time for those new strategies to become second-nature.

It reminds me of sports in a way. Teams start running a new wrinkle of offense in the NFL like the wildcat and it takes a few seasons for teams to instinctively know how to play defense correctly against that option.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#55

I'm one of the authors of the bot, AMA

Very impressive. If my understanding of how the AI works is correct, it is using a pre-computed strategy developed by playing trillions of hands, but it is not dynamically updating that during game play, nor building any kind of profiles of opponents. I wonder if by playing against it many times, human opponents could discern any tendencies they could exploit. Especially if the pre-computed strategy remains static.

We played 10,000 hands of poker over the course of 12 days in the 5 humans + 1 AI experiment, and 5,000 hands per player in the 1 human + 5 AI's experiment. That's a good amount of time for a player to find a weakness in the system. There's no indication that any of the players found any weaknesses.

In fact, the methods we use are designed from the ground up to minimize exploitability. That's a really important property to have for an AI system that is actually deployed in the real world.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#56
post #54

Curious, why was 100BB used for six max? If I recall right, the head ups experiment was 200BB?

Guessing it's because it's most similar to a regular 6max game. Also it should limit lower the number of possible ways to play a hand, less chips means the correct choices are easier, so maybe it's computationally easier

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#57

I'm one of the authors of the bot, AMA

Neal - super interesting stuff. Couple of questions:

1) What were the reasons for choosing 6-handed play (assuming logistical and costs)? It would be interesting to see how the bot’s strategy would differ in a full ring game. 2) Are there any plans to commercialize the bot as a tool for training human players?

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#58
post #45
post #38

Earlier quoted context omitted.

> you don't need to adapt to opponent weaknesses to win at poker at the highest levels that may be true for limit poker, but in a no-limit tournament the best this bot could do is not lose. as the pressure increases with the blinds and the players are forced to bluff and call bluffs how does this bot avoid folding itself to death from a run of bad cards? I could see this bot doing well at cashing but I don't see how…

I couldn't find it confirmed in the primary or secondary article, but I would bet the bot is just playing cash at a fixed stack depth rather than a tournament; just like in the wild, bots are much more of a problem in online cash than online tournaments. Dynamically adjusting strategies by stack depth, number of players, and pay jumps, would probably be several orders of magnitude more complex.

> There were two formats for the experiment: five humans playing with one AI at the table, and one human playing with five copies of the AI at the table. In each case, there were six players at the table with 10,000 chips at the start of each hand. The small blind was 50 chips, and the big blind was 100 chips.

In the fb article linked above.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#59
post #15

So let me see if I understand this. I don't believe it's hard to write a probabilistic program to play poker. That's enough to win against humans in 2-player. With one AI and multiple professional human players sitting at a physical table, the humans outperform the probabilistic model because they take advantage of each other's mistakes/styles. Some players crash out faster but the winner gets ahead of the safe proba…

Interesting article. Too bad a don't have a subscription to read the paper.

The bot played like 10 000 hands. There is no way that is enough to prove it's better or worse than the opponents.

More so in no-limit where some key all-ins can turn the game up side down. The variance is higher than limit or fixed, right?

I did a heads up Texas holdem fixed bot with "counter factual regret minimization" like 8 years ago from a paper I read. It had to play like 100 000 hands vs a crappy reference bot to prove it was better.

Strategy detection in so short games is probably worthless.

The edge is probably in seeing who are tired or drunk in paper poker.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#60
post #54

Curious, why was 100BB used for six max? If I recall right, the head ups experiment was 200BB?

We considered both options but decided to go with 100BB because that is the standard in the poker world. It doesn't make a big difference for these techniques though.
Post reply on HN