Earlier quoted context omitted.
Engineer : hey I made this cool thing that can help people in public safety roles process information and make decisions more efficiently! It gives false positives but you save more time than it takes less time to weed through them. Someone nearby : well what if they use it to replace human thinking instead of augment it? Engineer : well they would be ridiculous. Nobody would ever think that’s a good idea. Marketing…
Refer to the post office scandal in Britain and the robodebt debacle in Australia. The authorities are just itching to have their brains replaced with by dumb computer logic, without regard for community safety and wellbeing.
Lack of Accountability as-a-Service! Very attractive proposition to negligent and self-serving organizations. The people in charge don't even have to pay for it themselves, can just funnel the organization money to the vendor. Encouraging widespread adoption helps normalizes the practice. If anyone objects, shut them down as not thinking-of-the-children and something-must-be-done (and every other option is surely too complicated/expensive).