Earlier quoted context omitted.
? In what way?
Just wait until an authoritarian state gets its hands on an AGI/ASI that it controls internally. Turning internal oppression into an unbreakable steady-state and using the AI for warfare against external rivals. Techno-optimists are delusional if they don't get spooked by things like this, which will happen if we as a species somehow can't get over authoritarian dictatorships within a few years to a few decades. Whic…
Me, I'm worried by the possibility of a "You Gotta Believe Me" attack[0]: even if done with the best of intentions (and everyone thinks they're on the good team), it risks a memetic monoculture: https://kitsunesoftware.wordpress.com/2019/12/30/memetic-mon...
[0] As fictionalised by Vernor Vinge in Rainbow's End