DeepMind has open-sourced the heart of AlphaGo and AlphaZero
1–10 of 91 posts
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#2I can't help but wonder when this stuff happens that the devs (or the leads) are worried about being let go, so they open source their stuff to be able to take it elsewhere.
Anyone here from DeepMind?
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#3Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games.
Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#4“The heart of” can mean many things, is this runnable or not? Also, they should open source the weights as well so that their claims can finally be verified independently.
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#5I can't help but wonder when this stuff happens that the devs (or the leads) are worried about being let go, so they open source their stuff to be able to take it elsewhere. Anyone here from DeepMind?
The people who left probably said that they would want to work on stuff usable by the public, this seems like an answer to that.
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#6Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.
They have their own LLMs such as PaLM
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#7Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.
The human in the loop reinforcement learning paper that powered chatgpt's training arose from deepmind's experiments with boardgames (and games). AGI is still an unsolved problem and deep RL that arose from the success of deepmind's experiments wth boardgames and games so far, will likely play a huge part in it
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#8I can't help but wonder when this stuff happens that the devs (or the leads) are worried about being let go, so they open source their stuff to be able to take it elsewhere. Anyone here from DeepMind?
These particular programs were bleeding edge when they were announced, but have been recreated and improved on outside of DeepMind since then. For example, LCZero today is stronger at chess than any of the DeepMind chess programs that were shown to the public. Of course we don't know if they got further behind the scenes. Of course LCZero and everything else relied on the published papers of DeepMind. That is, the papers were more important than the code.
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#9“The heart of” can mean many things, is this runnable or not? Also, they should open source the weights as well so that their claims can finally be verified independently.
Totally agree. I don't even know what benefit they'd get at this point from keeping some parts locked up.
Anyway if you want something runnable Leela has a nice reimplementation: https://github.com/leela-zero/leela-zero
Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero
#10Please do the same for Alphastar, the starcraft AI, that would be great.