Live data from Hacker News

AI Beats Four Top Poker Players

bbc.co.uk

111–120 of 234 posts

Re: AI Beats Four Top Poker Players

#111
Sounds like the end of online poker is very near. This version required a supercomputer and took a long time to decide its actions but those type of things tend to be quickly improved given enough motivation.

Even if poker sites could somehow perfectly detect automated players(which they can't of course), highly skilled poker is profitable enough that some people would be willing to manually execute the actions themselves as directed by the AI.

Re: AI Beats Four Top Poker Players

#112

Earlier quoted context omitted.

I found calculus and academia generally very difficult. I'm happy to know that you don't suffer from this terrible affliction which makes studying difficult. You don't need to know programming if you understand your workers and they understand it enough to convey to you the time & resource constraints. I have a million dollars for this project. What are the features and functions that will maximize my returns? Hire a…

Okay, here's a million dollars a year budget, who do you hire ? If you've read papers and know about deep reinforcement learning , you'll know who to hire.

I hire the guy that read the papers and know who to hire :)

In an orchestra, the conductor is not replaceable but the instrument players are. Similarly, someone who allocates his or other's capital cannot be easily replaced very much like the worker's.

Your engineer leaves there are 100 others ready to take the place. Business owner leaves you'd have to find a buyer to keep everyone going.

This is different from a CEO funded by VC's where you are still replaceable but nevertheless a lot harder to replace than the cost intensive worker.

Being on the profit generating part of the business and cost intensive part of the business helped me understand why such discrepancy exists-those who are able to read and perform in chaotic and uncertain environments will always be valued than those who directly affect the margin's as a result of the monetary figure attached to their time which is always far more costlier because cost centres do not generate new revenues. Your top sales guy makes $9 for every $1 spent on him (+$8) where as your top engineer costs $3 for every $0 he generates (-$3).

tl;dr: revenue generators are king while cost generators are easily swappable due to the high supply of it as a result of it being a far safer and financially stable perception.

Re: AI Beats Four Top Poker Players

#113

Andrew Ng posted a comment about this on facebook: "I'm thrilled about Libratus' Poker triumph--this is a huge step for AI. Othello/Checkers/Chess/Go were theoretically solvable with minimax tree search and sheer computation; but poker, which requires bluffing, needs sophisticated modeling of your opponents and new algorithmic principles. CMU's Tuomas Sandholm has also (in a private email) promised to publish their a…

I'm surprised that Andrew Ng made this claim. The strategy that was built for Libratus' predecessor did not do sophisticated modeling of the opponents, or use new algorithmic principles. Poker is solved using a very large game tree, just as with the other games. The structure of the tree is modified to support the notion of hidden state, but beyond that it is essentially the same as the other games. The structure for…

You have to model opponent's behavior though. For example, the probability opponent will fold when AI bets a certain amount.

Re: AI Beats Four Top Poker Players

#114

Earlier quoted context omitted.

Okay, here's a million dollars a year budget, who do you hire ? If you've read papers and know about deep reinforcement learning , you'll know who to hire.

I hire the guy that read the papers and know who to hire :) In an orchestra, the conductor is not replaceable but the instrument players are. Similarly, someone who allocates his or other's capital cannot be easily replaced very much like the worker's. Your engineer leaves there are 100 others ready to take the place. Business owner leaves you'd have to find a buyer to keep everyone going. This is different from a CE…

Hint hint: you're the most replaceable one in this setup

Re: AI Beats Four Top Poker Players

#115
post #57
post #45

Earlier quoted context omitted.

They are at worst top 15 HUNL players in the world.

How was this determined? Online play?

Yes from online play but there aren't any official rankings. It's hard to determine exact rankings because it's rare for 2 world class players to face off over a large enough number of hands to give a significant sample but a loose hierarchy does exist. You can tell where a player sits in that hierarchy by who he is willing or unwilling to play. It's not an exact science but I agree that all of these players are unquestionably elite and the AI has beaten them to an extent that it would be a very strong favourite over a team compromising of the true top 4 players.

Re: AI Beats Four Top Poker Players

#116

Sounds like the end of online poker is very near. This version required a supercomputer and took a long time to decide its actions but those type of things tend to be quickly improved given enough motivation. Even if poker sites could somehow perfectly detect automated players(which they can't of course), highly skilled poker is profitable enough that some people would be willing to manually execute the actions thems…

Not really. 1v1 is just a small part of poker. Ring games are a whole different beast.

Re: AI Beats Four Top Poker Players

#117

Andrew Ng posted a comment about this on facebook: "I'm thrilled about Libratus' Poker triumph--this is a huge step for AI. Othello/Checkers/Chess/Go were theoretically solvable with minimax tree search and sheer computation; but poker, which requires bluffing, needs sophisticated modeling of your opponents and new algorithmic principles. CMU's Tuomas Sandholm has also (in a private email) promised to publish their a…

I'm surprised that Andrew Ng made this claim. The strategy that was built for Libratus' predecessor did not do sophisticated modeling of the opponents, or use new algorithmic principles. Poker is solved using a very large game tree, just as with the other games. The structure of the tree is modified to support the notion of hidden state, but beyond that it is essentially the same as the other games. The structure for…

> Poker is solved using a very large game tree

You mean Libratus' strategy used a very large game tree. That is not the only strategy. Take a look at research from the University of Alberta [0]. Also, I'm not certain Libratus' strategy can be simplified to "very large game tree" as I haven't seen the paper, yet.

While finding a Nash equilibrium means no other player can beat you, it doesn't mean you're going to make the most money in a big ring game. A different strategy might lose money to an equilibrium player, but exploit a different, weak player so much that it's worth the loss.

[0] http://poker.cs.ualberta.ca/publications.html

Re: AI Beats Four Top Poker Players

#118

Anyone that's interested in reading a more detailed account of the experiment can do so here: http://www.pokerlistings.com/libratus-poker-ai-smokes-humans... The above article spells out some of the details of the competition. The winrate (14.72bb/100) that the AI achieved over the 120k hand sample is almost certainly not due to luck. It is a huge winrate that most pros have to employ strong game selection techniques…

[deleted]

Re: AI Beats Four Top Poker Players

#120

Earlier quoted context omitted.

Okay, here's a million dollars a year budget, who do you hire ? If you've read papers and know about deep reinforcement learning , you'll know who to hire.

I hire the guy that read the papers and know who to hire :) In an orchestra, the conductor is not replaceable but the instrument players are. Similarly, someone who allocates his or other's capital cannot be easily replaced very much like the worker's. Your engineer leaves there are 100 others ready to take the place. Business owner leaves you'd have to find a buyer to keep everyone going. This is different from a CE…

Funny, I know more people who are asking about machine learning than people who are experts. So who is in high supply?
Post reply on HN