I struggle to understand entropy because it’s meaning seems to shift in subtle ways across disciplines (cryptography, thermodynamics, cs, etc) and I’m never quite sure if the which version I’m getting. Is there a basic definition of entropy that’s extended in different contexts?
There are so many types of entropy. Why not understand it in your domain and then backtrack the more general definition?