Hello!
I want to explore basics of information theory. Despite having math background, I've realized that I lack a comprehensive understanding of key concepts (e.g. entropy) in this area. I am particularly interested in formal connection between compression and intelligence.
I'm currently seeking resources that would work for self-learning, ideally Jupyter notebooks that would allow me to interactively experiment with the simulations/examples. In the absence of such resources, a book with exercises section could also work.
Thanks!