Post gore, rape and torture in places where people don't want to see that and you should lose the right to have internet access. Criminalize this behavior.
The trauma of Facebook’s content moderators
41–50 of 268 posts
Re: The trauma of Facebook’s content moderators
#42Can we build better AI off of the data these moderators have generated to make their lives easier? Can you crowdsource the moderation task to double check what the ai is flagging?
>Can you crowdsource the moderation task to double check what the ai is flagging? This would help with false positives, which is a noble goal. But it would not help with false negatives, which is imo a very disastrous consequence in this specific scenario. Something that isn't CP got marked as CP? Sure, a moderator can manually doublecheck that flag and override if needed. Something that is CP didn't get marked as CP…
Or to restate, sites that rely purely on manual moderation of content that breaks rules still has content that breaks rules leak through all the time.
Re: The trauma of Facebook’s content moderators
#43Earlier quoted context omitted.
Do you want "insane and unhealthy" people who voluntarily look at horrifying stuff deciding whether that stuff should be allowed on the platform, though? It'd be like having a jury pool made up of serial killers.
>Do you want "insane and unhealthy" people who voluntarily look at horrifying stuff deciding whether that stuff should be allowed on the platform, though? These kinds of bottom of the barrel places of employment tend to have their policies and procedures tuned to make sure employees do things the way the company wants them done. That's just the nature of doing an unskilled, non-laborious job for a BigCo. There will b…
Yes, but their hiring pool tends to be "everyone".
Those procedures might not work as well if your hiring pool is explicitly confined to "the people who watch ISIS torture videos for fun". I suspect standard policies and procedures include "fire the people who get off on this stuff".
Re: The trauma of Facebook’s content moderators
#44Post gore, rape and torture in places where people don't want to see that and you should lose the right to have internet access. Criminalize this behavior.
We as a society have decided that negligent actors can do enough harm to themselves or others in operating an automobile on publicly-owned roads, that we compel individuals to seek license from the government to drive vehicles on those roads. The license is a revocable priveilege that has to be earned by ongoing demonstrations of competency.
One could imagine a parallel system for "web privileges", although it sounds dystopian at first blush, in contrast to the unprecedented freedoms we enjoy on the web, today.
The tricky thing is that it's relatively hard to precisely track identity and intentional authorship on the internet. It's also easy to imagine somebody losing their internet privileges, because some botnet hijacked their printer and used it to spread X-rated content. In the analogy, it's hard to disambiguate between drivers and vehicles.
Maybe we'd require some biometric login system, provided by the government, to use a web browser. It's hard to imagine implementing any such system in a way that doesn't make the attack surface bigger, but harder problems have been solved.
I can't imagine how "commercial web licenses" would work, though. That's an interesting space for thought.
Re: The trauma of Facebook’s content moderators
#45I recall a statistic from about 10 years ago that computer forensic investigators in law enforcement burn out after two years due to the trauma of the images they are exposed to.
There's likely some confounding factors. Pressing "go" on the overpriced software tools and then entering into evidence what you find is the lowest level of work in that field so the churn is going to naturally be very high as people move up or out. The pay also isn't that great.
- Facebook: it's violating rules? Delete, next.
- Forensic IT on a multi TB disk full with child porn: document every photo, what it shows, extract identifiable faces to cross reference with other content (to check for recurring places and victims), and the process is even more gory for video content. You have to watch every second or the defense can attempt "you didn't watch the video in full where the perp gives the victim an ice cream at the end" or whatever else. The amount of time you spend with documenting a single photo or video is many orders of magnitude worse than FB content mods.
Re: The trauma of Facebook’s content moderators
#46It's probably a bit controversial to say this, but haven't large sites had to deal with these problems for years by the time the likes of Facebook/Twitter/YouTube/Instagram/whatever came around? It's obviously horrible doing this as a job and it's obviously a bit more common on Facebook than say, a large old school internet forum, but... at least in this case people are paid to do this. Reddit mods and old school for…
I think it's fair to say the sheer quantity has changed since Facebook first came around (FB predates smartphones for one!) I also think part of the objection here is around off-shoring. It's similar to other complaints about off-shored jobs: we're farming out unpleasant work to people that get paid less and have much less support (e.g. mental health).
That's an interesting point, and has me wondering something.
If a site like Facebook opened up a volunteer moderator scheme where people could sign up to filter out stuff that broke their rules, would it make things better or worse on a moral level?
What about a US/Europe based agency that did this thing onshore as a contract deal?
Re: The trauma of Facebook’s content moderators
#47Post gore, rape and torture in places where people don't want to see that and you should lose the right to have internet access. Criminalize this behavior.
That sounds attractive until one starts to delve into the implementation details. How would you implement it?
Re: The trauma of Facebook’s content moderators
#48It's probably a bit controversial to say this, but haven't large sites had to deal with these problems for years by the time the likes of Facebook/Twitter/YouTube/Instagram/whatever came around? It's obviously horrible doing this as a job and it's obviously a bit more common on Facebook than say, a large old school internet forum, but... at least in this case people are paid to do this. Reddit mods and old school for…
Re: The trauma of Facebook’s content moderators
#49Post gore, rape and torture in places where people don't want to see that and you should lose the right to have internet access. Criminalize this behavior.
That sounds attractive until one starts to delve into the implementation details. How would you implement it?
- mom works as a freelancer and the kid uses her computer to post bad content. Does she lose her job?
- someone trolls his mate for lolz.
Re: The trauma of Facebook’s content moderators
#50Post gore, rape and torture in places where people don't want to see that and you should lose the right to have internet access. Criminalize this behavior.
It's probably illegal just about everywhere to post pictures of rape and torture.
You may want to reword your comment, unless you meant for it to imply that it should be legal to post gore, rape, and torture for people who want to view those.