Bandit based Monte-Carlo planning [pdf]

Post by gwern » Thu, Jul 07, 2016, 8:53 PM UTC

Post by nurettin » Fri, Jul 08, 2016, 8:49 AM UTC

zhanwei wrote: post #2

UCT is a very simple idea that works surprisingly well across very diverse domains. Can't emphasize its generality enough, you can throw different problems at it and it can give you decent (may not be the best) result without using any additional domain knowledge. It is also very easy to work with, you can easily tweak the algorithm and add heuristics for your specific domains. Also relevant: UCT applied to partially…

Post by nurettin » Fri, Jul 08, 2016, 11:13 AM UTC

zhanwei wrote: post #4

nurettin wrote: post #3

Earlier quoted context omitted.

I've coded and tested sparse lookahead in a trading algorithm before using a comprehensive example as a guide. Do you know of any comprehensive walkthrough examples implementing a UCT scenario that I can use to implement and verify my results?

This tutorial seems quite good. Covers the basic and various useful UCT extension: https://webdocs.cs.ualberta.ca/~mmueller/courses/2014-AAAI-g... However, the tutorial doesn't work towards a working implementation. I think you can verify your results against benchmark problems. There are a number of good implementations around: UCT implementation with many MDP benchmark problems: https://github.com/bonetblai/mdp-eng…