Nay-sayers need to decide whether they fear AI because AI is dumb and will fuckup or because AI is smart and will take over.
Both are valid concerns, no need to decide. Take the USA: They are currently lead by a patently dumb president who fucks up the global economy, and at the same time they are powerful enough to do so! For a more serious example, consider the Paperclip Problem[0] for a very smart system that destroys the world due to very dumb behaviour. [0]: https://cepr.org/voxeu/columns/ai-and-paperclip-problem
But let's consider real life intelligence:
- Our super geniuses do not take over the world. It is the generationally wealthy who do.
- Super geniuses also have a tendency to be terribly neurotic, if not downright mentally ill. They can have trouble functioning in society.
- There is no thought here about different kinds of intelligence and the roles they play. It is assumed there is only one kind, and AI will have it in the extreme.