Live data from Hacker News

Facebook flooded with 'sextortion' and revenge porn, files reveal

theguardian.com

1–10 of 81 posts

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#2
I am surprised their system for catching bad content is only user reports/flags.

While revenge porn and stuff is bad, there are a number of known child related incidents.

So if a private group of scumbags, are posting stuff to a private group, noone will know unless someone within reports.

Who needs the darkweb when u can have a private Facebook group?

Edit: as per replies below, they do use image recognition aswell for I guess known content lists

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#3
> "54,000 potential cases... and 33 of the cases reviewed involved children."

That's 0.06% of reviewed cases, which is frankly less than I would have thought. I suspect that child abusers are a more savvy lot than the average chucklehead who does something like this.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#4
post #2

I am surprised their system for catching bad content is only user reports/flags. While revenge porn and stuff is bad, there are a number of known child related incidents. So if a private group of scumbags, are posting stuff to a private group, noone will know unless someone within reports. Who needs the darkweb when u can have a private Facebook group? Edit: as per replies below, they do use image recognition aswell…

I suspect they sign up to the IWF lists for filtering.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#5
post #2

I am surprised their system for catching bad content is only user reports/flags. While revenge porn and stuff is bad, there are a number of known child related incidents. So if a private group of scumbags, are posting stuff to a private group, noone will know unless someone within reports. Who needs the darkweb when u can have a private Facebook group? Edit: as per replies below, they do use image recognition aswell…

They also use image recognition to detect nudity and previously classified child porn.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#6

> "54,000 potential cases... and 33 of the cases reviewed involved children." That's 0.06% of reviewed cases, which is frankly less than I would have thought. I suspect that child abusers are a more savvy lot than the average chucklehead who does something like this.

I am sure there is a ton of stuff going on in the developing world were nobody is used to reporting anything.

Edit: Happy to see someone is leaking this stuff given how many flip flops we had to sit threw before someone admitted fake news was a thing.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#7
Yea, someone tried doing this whole 'sextortion' thing to me on FB.

I laughed at them. I used to work in porn, you think you're showing people something they haven't seen (let alone probably want to see again since I 'retired' [AKA got married?])

Sad that shameless people such as myself seem to be immune to this kind of thing. Perhaps everyone should have a career in porn just to eliminate this issue.

Give me a break.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#8
>and the challenges for moderators, who say they are overwhelmed by the volume of work, which means they often have “just 10 seconds” to make a decision.

Maybe Facebook should just hire more moderators? I know they'd love to totally relegate this to some awesome NLP algorithm but we're not there yet. Facebook makes more than enough money to bring on some more employees (and clean up their guidelines).

EDIT: oops, had two articles from the guardian on FB up and referenced the wrong one.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#9
post #5
post #2

I am surprised their system for catching bad content is only user reports/flags. While revenge porn and stuff is bad, there are a number of known child related incidents. So if a private group of scumbags, are posting stuff to a private group, noone will know unless someone within reports. Who needs the darkweb when u can have a private Facebook group? Edit: as per replies below, they do use image recognition aswell…

They also use image recognition to detect nudity and previously classified child porn.

No, they use Magic Number among a bunch of various tricks. You can't really call it image recognition, more like 'data-hash comparison.' To train true image recognition would require a LARGE subset of stored illegal pornography.

Re: Facebook flooded with 'sextortion' and revenge porn, files reveal

#10

>and the challenges for moderators, who say they are overwhelmed by the volume of work, which means they often have “just 10 seconds” to make a decision. Maybe Facebook should just hire more moderators? I know they'd love to totally relegate this to some awesome NLP algorithm but we're not there yet. Facebook makes more than enough money to bring on some more employees (and clean up their guidelines). EDIT: oops, had…

"Maybe Facebook should just hire more moderators? I know they'd love to totally relegate this to some awesome NLP algorithm but we're not there yet. Facebook makes more than enough money to bring on some more employees (and clean up their guidelines)."

There are systems that can detect porn pretty reliably. Helping moderators spot any porn more quickly will also let them spot revenge porn more quickly. Any correct or false positives can be fed back into detection systems. It might still take more moderators, though. Facebook needs more anyway given the size of user base and money available for moderation.

Post reply on HN