Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A Tiny Boltzmann Machine

eoinmurray.info

Post reply on HN
Print view View original

21–30 of 59 posts

Re: A Tiny Boltzmann Machine

#21

Post by nonrandomstring »

bwestergard wrote: post #9
nonrandomstring wrote: post #6

This takes me back. 1990, building Boltzman machines and Perceptrons from arrays of void pointers to "neurons" in plain C. What did we use "AI" for back then? To guess the next note in a MIDI melody, and to recognise the shape of a scored note, minim, crotchet, quaver on a 5 x 9 dot grid. 85% accuracy was "good enough" then.

Did the output sound musical?

For small values of "music"? Really, no. But tbh, neither have more advanced "AI" composition experiments I've encountered over the years, Markov models, linear predictive coding, genetic/evolutionary algs, rule based systems, and now modern diffusion and transormers... they all lack the "spirit of jazz" [0]

[0] https://i.pinimg.com/originals/e4/84/79/e484792971cc77ddff8f...

Re: A Tiny Boltzmann Machine

#23

Post by itissid »

IIUC, we need gibbs sampling(to compute the weight updates) instead of using the gradient based forward and backward passes with today's NNetworks that we are used to. Any one understand why that is so?

Re: A Tiny Boltzmann Machine

#26

Post by mac9 »

BigParm wrote: post #25

That font with a bit of margin looks fantastic on my phone specifically. Really nailing the minimalist look. What font is that?

"font-family: ui-sans-serif, system-ui, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Noto Color Emoji";"

from the css so odds are it's whatever your browser or OS's default sans font is, in my case it's SF Pro which is an Apple font though it may vary if you use a non Apple device.

Re: A Tiny Boltzmann Machine

#27

Post by nayuki »

CamperBob2 wrote: post #20
nayuki wrote: post #16

Oh, this is a neat demo. I took Geoff Hinton's neural networks course in university 15 years ago and he did spend a couple of lectures explaining Boltzmann machines. > A Restricted Boltzmann Machine is a special case where the visible and hidden neurons are not connected to each other. This wording is wrong; it implies that visible neurons are not connected to hidden neurons. The correct wording is: visible neurons a…

Alternatively: visible and hidden neurons do not have internal connections within their own type. I'm a bit unclear on how that isn't just an MLP. What's different about a Boltzmann machine? Edit: never mind, I didn't realize I needed to scroll up to get to the introductory overview. What 0xTJ's [flagged][dead] comment says about it being undesirable to hijack or otherwise attempt to reinvent scrolling is spot on.

> I'm a bit unclear on how that isn't just a multi-layer perceptron. What's different about a Boltzmann machine?

In a Boltzmann machine, you alternate back and forth between using visible units to activate hidden units, and then use hidden units to activate visible units.

> What 0xTJ's [flagged][dead] comment says about it being undesirable to hijack or otherwise attempt to reinvent scrolling is spot on.

The page should be considered a slideshow that is paged discretely and not scrollable continuously. And there should definitely be no scrolling inertia.

Post reply on HN