But why aren't we coming at it, also, from the other direction?
But why not twist ourselves (or enhance ourselves), to become more like those machine qualities we admire?
Savants arguably display superintelligence in a specialized niche. Why aren't we investigating how to add that module to regular cognition? Super-recognisers, and super-memorizers are often far more "neurotypical" than savants (in the sense they may be broadly 'high functioning' which seems less common among savants), why aren't we figuring out how to augment our cognition with those abilities?
Similarly, but requiring more broad-mindedness to consider, sages through the ages have acquired supernormal abilities (facts which are as accepted in some cultures as they are ridiculed in others), why are we not investigating how to augment our societies with these qualities?
More prosaic, but perhaps no less startling examples include chess prodigies, music prodigies, bodily kinesthetic prodigies, puzzle solving prodigies, and so on. It seems that a rigorous unified program of study devoted to all these types of skills may yield ways to augment ourselves with those types of abilities?
Anyway, just a thought throwing out there into the ether wondering why we aren't as focused on developing innate human superintelligence given we are so focused on creating machine AGI superintelligence. Oh well... :)
A super intelligence that is human based, and possibly distributed among all of us, could be far more manageable and less catastrophic than a machine innate superintelligence.