Earlier quoted context omitted.
Purely speculation on my part, but I tend to feel similarly, and I think the reason is that the mugger includes a physical threat of violence. Evolutionarily, the emergence of an economy with capital at modern-day scales are so new that we haven't had time to really adjust emotionally. It kind of reminds me of the various birds on previously untouched-by-humanity islands that had no fear of humans and would just sit…
I had a business partner/family member steal money from me in our business. It very much hurt and was a painful experience hoping for vengence. Perhaps SBF being distant from you is what makes you indifferent.
I'm also pretty distant from a mugging that might happen today, but I find myself getting angry about it, so that also seems to contradict the theory that it's about distance (though to be clear, I largely agree with you and I suspect distance is going to be a factor for most or maybe the vast majority of people).