Live data from Hacker News

DeepMind has open-sourced the heart of AlphaGo and AlphaZero

twitter.com

11–20 of 91 posts

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#11
post #3

Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.

Google researchers invented Transformers and Deepmind pioneered reinforcement learning.

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#12
post #3

Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.

Board games have been used in AI since the beginning. They provide a good environment as we know the rules and control them. Also as everybody uses them it is easier to compare different algorithms. Most advances in AI were done in board games. Most probably chatGPT uses lot of those things you think are irrelevant in board games (reinforcement learning for fine tuning the responses with human feedback, same algorithms used in board games).

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#13

I can't help but wonder when this stuff happens that the devs (or the leads) are worried about being let go, so they open source their stuff to be able to take it elsewhere. Anyone here from DeepMind?

These particular programs were bleeding edge when they were announced, but have been recreated and improved on outside of DeepMind since then. For example, LCZero today is stronger at chess than any of the DeepMind chess programs that were shown to the public. Of course we don't know if they got further behind the scenes. Of course LCZero and everything else relied on the published papers of DeepMind. That is, the pa…

Agreed, most "newly released" "open sourced" products have typically been in the pipeline for at least half a decade.

That said many have been retooled for a more specific purpose before public release.

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#15
post #3

Must feel pretty bad being a rank and file dev at DeepMind and realizing that your leads had all the talent and funding in the world that they could have used for building language model products and instead they heavily invested in solving board games. Then you realize they get paid >x10 of what you are and they're fine, but the next layoff is likely gonna get you.

Games offer clear perimeters and have lotsa depth to them.

Humans are also trained in games when young, and even into adulthood, think war games that are held semi-annually between countries.

These are just board games with increased stakes and additional variables.

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#16
Worth noting that while AlphaGo and AlphaZero are incredible achievements, the amount of actual code to implement them isn't very much.

If you have the research paper, someone in the field could reimplement them in a few days.

Then there is the large compute cost for training them to produce the trained weights.

So, opensourcing these bits of work without the weights isn't as major a thing as you might imagine.

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#17

Obligatory note that AlphaZero has long since been surpassed by its independently developed cousin Leela Chess Zero(which is also open source btw), and also Stockfish has more than caught up and remains competitive with MCTS engines.

Did stockfish use any tech from alphazero & co ? or has it managed to catch up keeping itself "pure" ?

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#19
post #17

Obligatory note that AlphaZero has long since been surpassed by its independently developed cousin Leela Chess Zero(which is also open source btw), and also Stockfish has more than caught up and remains competitive with MCTS engines.

Did stockfish use any tech from alphazero & co ? or has it managed to catch up keeping itself "pure" ?

They use neural networks since Stockfish 12, but not in the same way that AlphaZero did:

https://www.chessprogramming.org/Stockfish_NNUE

Re: DeepMind has open-sourced the heart of AlphaGo and AlphaZero

#20

I can't help but wonder when this stuff happens that the devs (or the leads) are worried about being let go, so they open source their stuff to be able to take it elsewhere. Anyone here from DeepMind?

These particular programs were bleeding edge when they were announced, but have been recreated and improved on outside of DeepMind since then. For example, LCZero today is stronger at chess than any of the DeepMind chess programs that were shown to the public. Of course we don't know if they got further behind the scenes. Of course LCZero and everything else relied on the published papers of DeepMind. That is, the pa…

There's an interesting bias I've noticed on HN where a lot of people still believe AlphaZero is the state of the art in computer chess, when that hasn't been true except for a short while after the release. AZ still gets posted and upvoted today while newer improvements in other engines are discussed far less.

I guess it's because AZ came out of Google?

Post reply on HN