Viewing profile — tasteslikenoise

The whole polynomial functions that give the truncations of the exponential Taylor series are also well-behaved in a way that's really surprising if you haven't thought about it be…

A different but to my taste more mathematically conventional way to make this argument would be instead to say that a symbol is a function from the square to [0, 1], that is, a gra…

That's right, here log(k) - H(p) is really the relative entropy (or KL divergence) between p and the uniform distribution, and all the same stuff is true for a different "reference…

I've always favored this down-to-earth characterization of the entropy of a discrete probability distribution. (I'm a big fan of John Baez's writing, but I was surprised glancing t…