> Now I'm curious. The world you describe seems quite hostile to someone with your beliefs
That's because I don't have beliefs, I have data. I'm not interested in "beliefs". I'm interested in being able to concretely prove something with varying degrees of certainty, and I won't present my findings and conclusions unless I have the strongest available data to back them up.
To autopsy your assertion even further, you could extrapolate to the entire world. Most people in the world don't really want to know why the world is the way it is, or even why they do the things they do. People don't like that they can be quantified, that they can be predicted if someone, somewhere, with enough knowledge and understanding has enough data about them. Yet Facebook and Google and Twitter and YouTube do this every day, fairly easily nowadays I might add. It only upsets people when its in their face and clearly visible. When they can't turn away from it and deny it.
The nearly wholesale rejection of evolutionary biology, psychology, and the Big Five personality traits by a subset of certain people is hilarious because 1) its anti-science, which is made even more ridiculous given the credence these groups place on science and 2) it not only can be, but often is used against them by researchers who have no moral misgivings about the nature of the science and accept it for what it is - its neither inherently good nor bad, its just how we evolved based on the selective pressures nature placed upon our species.
> how and why are you in it?
The why is probably easier to answer than the how. By their own admission, I bring value to their organizations. When someone asks me what I do, instead of going through a bunch of technobabble and mathematics/statistics jargon I just tell them, "I bring order to chaos." It usually sparks more interesting conversations than talking about R, K-means clustering, Bayesian inference, and all the other jargon surrounding data science that frankly almost no one besides mathematicians, statisticians, and other data scientists will understand anyway. The second part of the "why" is "enormous consulting fees". :)
The how is a very long post that I just don't have time to type up right now.