Why does it matter if the flagging is automatic? Does that somehow make it more acceptable? The popularity of this view makes me wish more people read Kafka. A future tyranny might end up not being Orwell's 1984 or Huxley's Brave New World, but a kafkesque nightmare where people are lost in a world of AI giving out absurd punishments. [1] Kafka's book The Castle [2] is essentially about this, although I think his aph…
Neil Postman discusses this at length in Technopoly: The Surrender of Culture to Technology (1992):
> Naturally, bureaucrats can be expected to embrace a technology that helps to create the illusion that decisions are not under their control. Because of its seeming intelligence and impartiality, a computer has an almost magical tendency to direct attention away from the people in charge of bureaucratic functions and toward itself, as if the computer were the true source of authority. A bureaucrat armed with a computer is the unacknowledged legislator of our age, and a terrible burden to bear.