Live data from Hacker News

No limit: AI poker bot is first to beat professionals at multiplayer game

nature.com

81–90 of 407 posts

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#81

I'm one of the authors of the bot, AMA

What table information does the bot take into account? Position? Other player's stack size?

>Regardless of which hand Pluribus is actually holding, it will first calculate how it would act with every possible hand .

Is this information used to form an idea of what other players might be holding based on how the other player acts and how closely that action matches Pluribus's 'what if' action?

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#82

I'm one of the authors of the bot, AMA

First of all, I laughed at the 20-second average per game in self-play, since I ran into the same thing and have been trying to speed up the algorithm but haven't been able to get it faster (without throwing more hardware at it).

Second, I haven't read everything, but I believe you are playing a cash-game and not tournament-style. Is that correct? If that is the case, any chance you will be doing a tourney-style version?

[For those who don't play, in cash, a dollar is a dollar. In Tourney play, the top 2 or 3 players get paid out, so all dollars are not equal, as your strategy changes when you have only a few chips left (avoid risky bets that would knock you out) or when you are chip leader (take risky bets when they are cheap to push around your opponents).]

Also, curious how much poker you folks play in the lab for "research".

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#83

Curious if we'll see human poker pros get much better in the coming years as they incorporate training regimens that involve bots (analogous to chess today vs. 50 years ago). Seems like this will be the trend in almost every game.

As someone who plays both games....I doubt it.

Poker is an incomplete information game with crushingly high variance. The bots strategy is likely not quantifiable.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#84

I'm one of the authors of the bot, AMA

Who were the pros? Are they credible endbosses? Seth Davies works at RIO which deserves respect but I've never heard of the others except Chris Ferguson who I doubt is a very good player by todays standards (or human being, for that matter), but I've never heard of the others when I do know the likes of LLinusLove (iirc, the king of 6max), Polk and Phil Ganford.

Is 10,000 hands really considered a good enough sample? Most people consider 100k hands w/ a 4bb winrate to be an acceptable other math aside. However, as your opponent and yourself play with equal skill, variance increases to the point where regs refuse to sit each other.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#85

Earlier quoted context omitted.

Any chance of the code being released or a cepheus style answer key being provided? http://poker.srv.ualberta.ca/strategy

I don't think the poker world would be happy with us if we did that. Heads-up limit hold'em isn't really played professionally anymore, but six-player no-limit hold'em is very popular.

Why are you concerned about the happiness of the poker world?

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#86

How long until a slightly worse version of this model is reverse engineered and appears at every table in online poker?

This is something I've always wondered, how come bots haven't taken over online poker considering how much money there is to be made, and all you need is to be slightly better than average right? Is high level poker really that hard to achieve?

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#87
post #54

Curious, why was 100BB used for six max? If I recall right, the head ups experiment was 200BB?

We considered both options but decided to go with 100BB because that is the standard in the poker world. It doesn't make a big difference for these techniques though.

Does Pluribus care about opponent's stack depth? From the examples, it appears stacks were reset after each hand.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#89
post #46
post #38

Earlier quoted context omitted.

> you don't need to adapt to opponent weaknesses to win at poker at the highest levels that may be true for limit poker, but in a no-limit tournament the best this bot could do is not lose. as the pressure increases with the blinds and the players are forced to bluff and call bluffs how does this bot avoid folding itself to death from a run of bad cards? I could see this bot doing well at cashing but I don't see how…

Optimal play includes bluffing. It's "optimal" according to game theory. For example, game theory may tell you that in a particular situation, you can't be exploited if you bluff 10% of the time. If the opponent bluffs less than that, you can come out ahead by more often folding when he bets. If the opponent bluffs more than 10%, you can call or reraise when he bets. But if he bluffs the optimal amount, it doesn't ma…

To add onto this, some players that truly abide by the GTO strategy will use a prop, for example a watch, to determine what play to make.

If you want your perceived range to be balanced and make x play 50% of the time and y play the other 50%, you look at the watch and if the second hand is in the first 30 seconds, you make x play, 30-60 seconds, y play.

That's just an example but your point is 100% accurate.

Re: No limit: AI poker bot is first to beat professionals at multiplayer game

#90

I'm one of the authors of the bot, AMA

What table information does the bot take into account? Position? Other player's stack size? >Regardless of which hand Pluribus is actually holding, it will first calculate how it would act with every possible hand . Is this information used to form an idea of what other players might be holding based on how the other player acts and how closely that action matches Pluribus's 'what if' action?

No, it's to mask actions. If you bet big with monsters and check with air 100% of the time, you opponent knows when to fold and bet.

iirc, the frequency of bets in that spot is roughly equivalent to the frequency of times you're definitely in front of your opponent in that particular spot, but not always with the hands that are beating your opponent.

The concept is called Game Theory Optimal (GTO) and it's pretty popular in higher stakes games.

Post reply on HN