Earlier quoted context omitted.
Indeed the latter is kind of a precursor to the former: AI has to be helpful enough for key use cases in order to become used in whatever critical ways cause it to serve as humanity's downfall. Setting aside the apocalyptic prediction in particular, this sort of thing is already the case with many things that have become irritating or pernicious at scale, like automated phone systems and SEO. The latter of those exam…
> AI has to be helpful enough for key use cases in order to become used in whatever critical ways cause it to serve as humanity's downfall. I'm sure the strong proponents of AI in all the places have never griped about false positive account permabans from cloud services or app stores. What could possible go wrong with turning a function over to an automated system that's PS: What we need are mandatory rights to appe…
I agree that bans and appeal handling needs a human in the loop to work as intended, to have some way of handling the false positives. Without a human in the loop the appeal process can just as well be removed entirely, because it won't fulfill its purpose.