Great site! Would be cool to be able to adjust the speed at which the simulation runs as well.
A Tiny Boltzmann Machine
31–40 of 59 posts
Re: A Tiny Boltzmann Machine
#32Fun article on David Ackley https://news.unm.edu/news/24-nobel-prize-in-physics-cited-gr... Do check out his T2 Tile Project.
The key takeaways are that there are lots of people involved with making these breakthroughs.
The value of grad students is often overlooked, they contribute so much and then later on advance the research even more.
Why does America look on research as a waste, when it has move everything so far?
Re: A Tiny Boltzmann Machine
#33Now the real question: is it you enjoying that nice page or is it a Boltzmann Brain? https://en.m.wikipedia.org/wiki/Boltzmann_brain
It doesn't matter.
It's Decartes demon all over again. Problem solved centuries ago. You can skin it however you want, it's the same problem.
Re: A Tiny Boltzmann Machine
#34> Here we introduce introduction to Boltzmann machines and present a Tiny Restricted Boltzmann Machine that runs in the browser. nit: should "introduction" be omitted?
[deleted]
Re: A Tiny Boltzmann Machine
#35The section after the interactive diagrams has no left padding and thus runs off the screen on iOS.
[deleted]
Re: A Tiny Boltzmann Machine
#36That font with a bit of margin looks fantastic on my phone specifically. Really nailing the minimalist look. What font is that?
[deleted]
Re: A Tiny Boltzmann Machine
#37This is very well made, and so nostalgic to me! My whole PhD between 2012-16 was based on RBMs and I learned so much about generative ML through these models. Research has come so far and one doesn't hear much about them these days but they were really at the heart of the "AI Spring" back then.
Re: A Tiny Boltzmann Machine
#38Great read!
One nit, a misspelling in the Appendix: derivce -> derive
Re: A Tiny Boltzmann Machine
#39Nice and clean explanation!
It brings up a lot of memories! Shameless plug: I made a visualization of an RBM being trained years ago: https://www.youtube.com/watch?v=lKAy_NONg3g
Re: A Tiny Boltzmann Machine
#40My understanding is that the Harmonium (Smolensky) was the first restricted Boltzmann machine, but maximized “harmony” instead of minimizing “energy.” When Smolensky, Hinton and Rummelhart collaborated, they instead called it “goodness of fit.”
The harmonium paper [1] is a really nice read. Hinton obviously became the superstar and Smolensky wrote long books about linguistics.
Anyone know more about this history?
[1] https://stanford.edu/~jlmcc/papers/PDP/Volume%201/Chap6_PDP8...