Earlier quoted context omitted.
Scott Aaronson has an insightful essay on this in chapter 9 of his excellent book, "Quantum Computing Since Democritus". The TL;DR is that quantum mechanics can be derived as a generalization of probability theory using the 2-norm instead of the 1-norm. In Aaronson's words: "Quantum mechanics is what you would inevitably come up with if you started with probability theory, and then said, let's try to generalize it so…
To counter your enthusiasm I must say that I rather disliked his reasoning. My problem is essentially that what Aaronson's calls "the theory" is a somewhat bastardized version of quantum mechanics that might suffice for quantum computing but, in my opinion, not for physics. I discussed the difference earlier: https://news.ycombinator.com/item?id=38255476
For a pure mathematician, quantum mechanics is a lovely introduction to Hilbert Spaces.