Earlier quoted context omitted.
If we retain the same semi-centralised power structures for governing society, then I think it's unavoidable that we will face the scenario you mention. We need to decentralise governance and power in a massive way if we are to avoid negative effects from these incredibly powerful technologies.
> We need to decentralise governance and power in a massive way Agreed but I’d also like to see human rights protected from the new decentralized governments. Not sure how that could work.
It really depends on how exactly you decentralize. Decentralization doesn't necessarily mean complete independence of the fragments; they can still federate into larger entities, and those entities can enforce such things. The trick is to make the power flow from the bottom up, not from the top down.
Here's a real world contemporary attempt to implement some approximation to that. I'm not claiming that it's anywhere near perfect... but it seems to be working, so far:
https://pdfhost.io/v/Hrr2IgtuS_SocialContractoftheDemocratic...