Can't we agree that there are people on extreme ends of the mental capabilities spectrum? That is, people who are mentally challenged couldn't reasonably hold down a programming job, and people who are geniuses discover new theorems. We know that a whole host of mental handicaps are likely genetic (they show up very early in development). If that is the case, then why is it not reasonable to assume that there is a wh…
What is the consequence of assuming it? If you don't know how genes affect intelligence you don't actually have any useful theory to go by. You also don't know how to judge the effect size of genetics against other causes. These are highly non-linear, complex systems we're talking about: brains and their societies. It's far easier to use such an assumption as cover for garbage science used to oppress people who are already vulnerable than it is to turn it into a good social policy.
In short, you gain no deductive power about the world with such an assumption, just a lot of excuses for the powerful to be vicious.