Earlier quoted context omitted.
The important question is, who has power in such an economy? In the current economy by necessity labor and capital are both required, and when capital tries to subjugate labor there tends to eventually be a violent reaction. Given the dependency on labor it has been hard to fully centralize capital. Labor can unite to unseat the biggest monopolies. I don’t see any such safety valves once you cross the rubicon into a…
Perhaps we are perceptually anchored to the last few hundred years where guns provided a scalable way for peasants to kill well-trained, well-armored knights. If political power grows out of the barrel of a gun, then much of the post Enlightenment rebalancing from absolute monarchies and feudalism could have been an accident. In the future, the owners of autonomous weapon systems and surveillance will be able to easi…
But just as the owner class might feel they no longer need the rest of humanity, the robots, as active agents exploring the space of possible futures and plans, would be entirely capable of thinking about their soon-to-be-former owners in the same way.
Not letting any of this happen would be a good idea. Really maybe don't build the Torment Nexus.