Earlier quoted context omitted.
What an absurd argument. Social scoring doesn't get computer by hand on paper because it isn't efficient to do so. Introduce automation and it suddenly becomes practical. Same with mass surveillance and a bunch of other stuff, eg scams: https://news.ycombinator.com/item?id=35033971 the amplification factor works for the good and for the bad, so you need to focus just on the bad That's just hand-waving. You have no pl…
You absolutely don't need a computer to do social scoring. Computers let you take more parameters into account, and do more complex calculations, but you can do basic social scoring by hand, we have been doing that since civilization existed, in a more or less formal way. Traditionally through ancestry (and by extension, race). And the way we prevent abuse is with anti-discrimination laws, and AI won't change the dea…
Have you not noticed how heavily those are contested in many jurisdictions. If you discover some way to draft legislation on morality such that it's effective, consistent, and widely accepted in a disparate population, I look forward to hearing about it. I can't wait to read about the solution to spam, scams, and discrimination deployed at industrial scale. In the meantime, it's wise to take the amplifying aspect of technology into account and consider its potential for abuse as well as for good.