To me, math is a medium of description much like painting or writing. It's units are not colors or words but points. A point, or "that which has no part", is much finer and carries with it far less baggage than something like a word. Points can be assigned numerical values and played with in clever ways. You can even sprinkle a fine dust of them over anything observable and create a copy of it to arbitrary degrees of precision.
I know math is far more than just the study of points, but I'm not convinced that math is anything more than our capacity to distinguish and describe extended to its limit. I also don't mean to belittle the accomplishments of mathematicians and theoreticians, I just think it's more reasonable to say that math is JUST the limit of description than it is to say that reality is JUST math.
After reading through some of the comments, I think many of us are on the same page.