Here we are, deep down in the dystopia of Automatic Content Classification by robots.
Far less important of an example, but I was just put in "Facebook jail" for 24 hours for posting a picture of my son at the beach in his bathing suit with no shirt. Y'know, as one does at the beach. I can only assume it's because my son has long hair and the Convolutional Neural Network or whatever decided he was a girl and therefore I'm a pervert.
Sadly it was the "appeal" I submitted that got me blocked. Presumably by a "human", but who knows.
Before I appealed they were simply going to not show the picture. Appealing got me in "trouble." That might be even worse than the original misclassification. On top of that, if I was actually a "community standards" violator who posted potential child exploitation imagery, I'm not sure how a 24-hour ban on activity on Facebook is of any use, either? Except I'm terrified to imagine a world where Meta might have called police on me based on the output of a neural network image classification.
Others have said but I'll say it again: This kind of business doesn't scale ethically. You can't have billions of people on a bulletin board. It doesn't work. Moderation is essential to modern communication. But you can't do moderation automatically or at scale and in a universal way.
Very dark patterns emerge the moment you go FAANG scale and toss algorithms tuning for advertising and "engagement" into the mix, and attempt to do so with the help of computers.
"Sad" as it is, we will need to "retreat" back into smaller forums and BBSs where communities self-police.
Facebook has infiltrated so many aspects of society. Want to interact with the parents from the local school your kids go to? You have to do that on Facebook. Event announcements? Keeping in touch with your distant aunt? Facebook.
If something like Facebook is really a universal utility, it will have to be put under public administration; like the post office. But clearly, that isn't going to happen and would have other problems.
I am going to have to find some other way to engage with old friends and family.
Frank Herbert had some intuition with his whole "Butlerian Jihad" thing.