DeepMind has open-sourced the heart of AlphaGo and AlphaZero

Post by [deleted] » Wed, Feb 15, 2023, 12:27 PM UTC

rhdunn wrote: post #39

londons_explore wrote: post #16

Worth noting that while AlphaGo and AlphaZero are incredible achievements, the amount of actual code to implement them isn't very much. If you have the research paper, someone in the field could reimplement them in a few days. Then there is the large compute cost for training them to produce the trained weights. So, opensourcing these bits of work without the weights isn't as major a thing as you might imagine.

There is Leela Zero ( https://github.com/leela-zero/leela-zero ) for Go and lc0/Leela Chess ( https://github.com/orgs/LeelaChessZero/repositories ) for Chess, where both provide trained weights. The Leela Chess project specifically have been working for a long time on training and refining the weights for Chess, as well as providing the code -- they allow you to see the history and performance over time for the vario…

Post by ArtWomb » Wed, Feb 15, 2023, 12:43 PM UTC

londons_explore wrote: post #16

Worth noting that while AlphaGo and AlphaZero are incredible achievements, the amount of actual code to implement them isn't very much. If you have the research paper, someone in the field could reimplement them in a few days. Then there is the large compute cost for training them to produce the trained weights. So, opensourcing these bits of work without the weights isn't as major a thing as you might imagine.

Post by randac » Wed, Feb 15, 2023, 12:49 PM UTC

mtlmtlmtlmtl wrote: post #20

throwaway81523 wrote: post #8

Earlier quoted context omitted.

These particular programs were bleeding edge when they were announced, but have been recreated and improved on outside of DeepMind since then. For example, LCZero today is stronger at chess than any of the DeepMind chess programs that were shown to the public. Of course we don't know if they got further behind the scenes. Of course LCZero and everything else relied on the published papers of DeepMind. That is, the pa…

There's an interesting bias I've noticed on HN where a lot of people still believe AlphaZero is the state of the art in computer chess, when that hasn't been true except for a short while after the release. AZ still gets posted and upvoted today while newer improvements in other engines are discussed far less. I guess it's because AZ came out of Google?

Post by leereeves » Wed, Feb 15, 2023, 1:03 PM UTC

ogoparootbbo wrote: post #7

kubb wrote: post #3

Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.

The human in the loop reinforcement learning paper that powered chatgpt's training arose from deepmind's experiments with boardgames (and games). AGI is still an unsolved problem and deep RL that arose from the success of deepmind's experiments wth boardgames and games so far, will likely play a huge part in it

Post by mensetmanusman » Wed, Feb 15, 2023, 1:19 PM UTC

londons_explore wrote: post #16

Worth noting that while AlphaGo and AlphaZero are incredible achievements, the amount of actual code to implement them isn't very much. If you have the research paper, someone in the field could reimplement them in a few days. Then there is the large compute cost for training them to produce the trained weights. So, opensourcing these bits of work without the weights isn't as major a thing as you might imagine.