Earlier quoted context omitted.
I'm not worried about actual AGI; infinitely powerful, not bound to the whims of any person or conglomerate. I see human atrocities born out of weakness, so I'm not worried about something that would have gain nothing from torturing or destroying us. That's assuming it can do and think everything we can, and doesn't need us as slaves. E.g. I like sparrows lots. I don't understand them, I wouldn't want them in my room…
Well I think that's a reasonable thought but in my opinion it's not really describing AGI. Rather, it's describing something near AGI that can be controlled. That's why I am vociferously against the "Friendly AI" movement, because fundamentally humans aren't friendly - and that doesn't mean friendly in terms of agreeable or altruistic. Rather "Friendly" as used in the FAI sense, means "Does not reject or override the…
https://aeon.co/essays/this-is-what-slavery-looks-like-today...