Alpha Go Zero: How and Why It Works
tim.hibal.org
Alpha Go Zero: How and Why It Works
1–10 of 116 posts
Re: Alpha Go Zero: How and Why It Works
#2I wonder how the STYLE of Alpha Go Zero is regarded by human experts. Is it far different from AlphaGo? Why bother learning from AlphaGo if they can learn from AlphaGo Zero?
Did they unleash a second "Master" program?
I am wondering if the "better" strategy moves are now super wacky and weird and break all theory.
Re: Alpha Go Zero: How and Why It Works
#3"On a long enough timeline, everything is a discrete game." (With apologies to _Fight Club_)
Personally, I look forward to the day when the software I own works for me to the extent of optimizing the decisions I make during the day, even many mundane ones. Properly executed, such a system could make a big difference in my quality of life. I believe that a big piece that is missing is a solid life-model, a life-representation, that can be optimized. Once that is defined, an RNN or MCS can optimize it and I can reap the benefits.
Re: Alpha Go Zero: How and Why It Works
#4I wonder how the STYLE of Alpha Go Zero is regarded by human experts. Is it far different from AlphaGo? Why bother learning from AlphaGo if they can learn from AlphaGo Zero? Did they unleash a second "Master" program? I am wondering if the "better" strategy moves are now super wacky and weird and break all theory.
At least initial reports are that alphaGo Zero is more human-like than Master. Zero packs even more of the inhuman ability to pick the most critical part of the board for each move, but less weird looking stuff.
In fact, one of the obvious differences between AlphaGo Zero and top human players, is much more play on safe opening spots, which has been out of fashion among human pros for a hundred years or so.
Re: Alpha Go Zero: How and Why It Works
#5Go has been studied for hundreds of years. In many cases, by people who study the game since their childhood and work on it as a full-time occupation.
The consequence of Alpha Go Zero is that it can, in a matter of days, disregard and surpass all human knowledge about the game.
Maximizing a score margin has been equated for a long time with maximizing your probability of winning. Alpha Go doesn't play like that... it's a substantial paradigm shift. If you see the early commentaries you will see that human players were initially saying Alpha Go moves were mistakes because they were slow and wasted opportunities to get more territory, to then realize that Alpha Go was actually winning.
Re: Alpha Go Zero: How and Why It Works
#6What makes this different from a minimax algorithm with alpha-beta pruning?
Re: Alpha Go Zero: How and Why It Works
#7"On a long enough timeline, everything is a discrete game." (With apologies to _Fight Club_) Personally, I look forward to the day when the software I own works for me to the extent of optimizing the decisions I make during the day, even many mundane ones. Properly executed, such a system could make a big difference in my quality of life. I believe that a big piece that is missing is a solid life-model, a life-repres…
Complete with creepy predictions like "Predicted optimal life path: $120,000 net worth, 63 year life span".
Re: Alpha Go Zero: How and Why It Works
#8"On a long enough timeline, everything is a discrete game." (With apologies to _Fight Club_) Personally, I look forward to the day when the software I own works for me to the extent of optimizing the decisions I make during the day, even many mundane ones. Properly executed, such a system could make a big difference in my quality of life. I believe that a big piece that is missing is a solid life-model, a life-repres…
If it is optimising all your decisions, even the mundane ones, is it really your life any more? If it plugged into your brainstem and took over, by definition nobody else would notice the difference (you always did what it said anyway, or you’d be suboptimal), so why not just flood the 20 watt carbon-based neural network with bliss drugs and let the silicon-based neural network be the person instead?
Re: Alpha Go Zero: How and Why It Works
#9Are there adversarial examples for Alpha Go Zero?
Re: Alpha Go Zero: How and Why It Works
#10"On a long enough timeline, everything is a discrete game." (With apologies to _Fight Club_) Personally, I look forward to the day when the software I own works for me to the extent of optimizing the decisions I make during the day, even many mundane ones. Properly executed, such a system could make a big difference in my quality of life. I believe that a big piece that is missing is a solid life-model, a life-repres…
If it is optimising all your decisions, even the mundane ones, is it really your life any more? If it plugged into your brainstem and took over, by definition nobody else would notice the difference (you always did what it said anyway, or you’d be suboptimal), so why not just flood the 20 watt carbon-based neural network with bliss drugs and let the silicon-based neural network be the person instead?
well if you chose and modified the representation of the world yourself, and set it so it would be making decisions based on a heuristic you provided it, then at the end of the day, it is not so different from how our biological circuits work, to the extent we have control over them