How to teach a Bayesian spam filter to play chess
dbacl.sourceforge.net
How to teach a Bayesian spam filter to play chess
1–10 of 34 posts
Re: How to teach a Bayesian spam filter to play chess
#2How about teaching it how to do ADDITION?
This would be a better experiment because (1) it is simpler and faster, (2) the feedback is unambiguous, (3) the ability to add is verifiable.
Essentially you supply it with all sums of all pairs of numbers from 0 to 99 and then see if it can compute 100+100.
Re: How to teach a Bayesian spam filter to play chess
#3How about teaching it how to do ADDITION? This would be a better experiment because (1) it is simpler and faster, (2) the feedback is unambiguous, (3) the ability to add is verifiable. Essentially you supply it with all sums of all pairs of numbers from 0 to 99 and then see if it can compute 100+100.
Bayesian classification works a bit like this: You have a set of inputs and a set of targets. By having seen a history of elements of the powerset of inputs and its manually tagged classes, the bayesian classificator learns how to classify new elements of the powerset of inputs.
Thus, a bayesian classifier has to know the classes and the inputs before. It cannot extrapolate from the sets it was trained on, since the bayesian approach does not see numbers as something that some operations are defined on, but only as symbols.
A simple backprop neural network can learn addition, though.
Re: How to teach a Bayesian spam filter to play chess
#4How about teaching it how to do ADDITION? This would be a better experiment because (1) it is simpler and faster, (2) the feedback is unambiguous, (3) the ability to add is verifiable. Essentially you supply it with all sums of all pairs of numbers from 0 to 99 and then see if it can compute 100+100.
Bayesian classification works a bit like this: You have a set of inputs and a set of targets. By having seen a history of elements of the powerset of inputs and its manually tagged classes, the bayesian classificator learns how to classify new elements of the powerset of inputs. Thus, a bayesian classifier has to know the classes and the inputs before. It cannot extrapolate from the sets it was trained on, since the…
Are you saying that a neural network can learn addition symbolically? Can you recommend a book or site to read about this?
Re: How to teach a Bayesian spam filter to play chess
#5Earlier quoted context omitted.
Bayesian classification works a bit like this: You have a set of inputs and a set of targets. By having seen a history of elements of the powerset of inputs and its manually tagged classes, the bayesian classificator learns how to classify new elements of the powerset of inputs. Thus, a bayesian classifier has to know the classes and the inputs before. It cannot extrapolate from the sets it was trained on, since the…
Are you saying that a neural network can learn addition symbolically? Can you recommend a book or site to read about this?
Can you recommend a book or site to read about this?
David MacKay wrote a good intro book on Bayesian, neural networks, and related topics: http://www.inference.phy.cam.ac.uk/mackay/itila/
Re: How to teach a Bayesian spam filter to play chess
#6On a random note, I was first introduced to Paul Graham's writings by his article on the Bayesian spam filter he wrote.
Re: How to teach a Bayesian spam filter to play chess
#7Earlier quoted context omitted.
Are you saying that a neural network can learn addition symbolically? Can you recommend a book or site to read about this?
Can you recommend a book or site to read about this? David MacKay wrote a good intro book on Bayesian, neural networks, and related topics: http://www.inference.phy.cam.ac.uk/mackay/itila/
Whether you're interested in the book or not, don't miss this page:
http://www.inference.phy.cam.ac.uk/mackay/itila/Potter.html
Should you buy the MacKay text or one by J.K. Rowling?
Re: How to teach a Bayesian spam filter to play chess
#8Earlier quoted context omitted.
Are you saying that a neural network can learn addition symbolically? Can you recommend a book or site to read about this?
Can you recommend a book or site to read about this? David MacKay wrote a good intro book on Bayesian, neural networks, and related topics: http://www.inference.phy.cam.ac.uk/mackay/itila/
I've looked at the chapter on neurall networks. It does not seem to address operations with symbols, only numbers...
Re: How to teach a Bayesian spam filter to play chess
#9On another random note, was anyone else dissapointed when they found out that a neural net is a fancy way of drawing a line through some points. i.e. regression.
Re: How to teach a Bayesian spam filter to play chess
#10Earlier quoted context omitted.
Can you recommend a book or site to read about this? David MacKay wrote a good intro book on Bayesian, neural networks, and related topics: http://www.inference.phy.cam.ac.uk/mackay/itila/
I've looked at the chapter on neurall networks. It does not seem to address operations with symbols, only numbers...
You can always encode symbols as numbers, and otherwise. That's what computers do, that's what you do when you do a sum by yourself, and that's what such a neural network should do too. (You should encode the symbols to a binary input, then decode the neural network output to symbols).