If anyone is interested in AI, I highly recommend joining Less Wrong, a community started by AI researcher Eliezer Yudkowsky. He started the community to convince people to focus on the "friendly AI problem". [1] I actually recommend that everyone read LW, but especially if you're interested in AI. [1] In a nutshell, the friendly AI problem is: assume we create an AI. It may rapidly become more intelligent than us, i…
If the AI is more intelligent, I'd prefer it take over anyway, even if it gets rid of us. When you have a child, do you want the child to stay at home and do what you say forever? Or do you want the child to succeed as much as possible? I want the latter.
An AI might be much more intelligent, but it has a goal system that basically says: "Make as many paperclips as you can". Everything it does will be with the singular purpose of making more paperclips. Not music, math, sport, culture or anything else that we think of as good. Not "help save intelligent creatures and animals from death". Only one goal - making more paperclips.
And if it decides that the optimal way to make paperclips just happens to involve death and destruction to humanity, that won't matter.
So yes, the AI might be more intelligent, but I still wouldn't want to trade humanity for an intelligence which doesn't do anything I value.