Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Comparison of the Best NSFW Image Moderation APIs 2018

adityaananthram.com

Post reply on HN
Print view View original

41–50 of 76 posts

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#41

Post by tyingq »

cataflam wrote: post #27
sytelus wrote: post #14

This is very cool comparison. I would really like folks at Netflix/Amazon to take this and build a feature that auto-skips through non-PG rated content so you can watch some of otherwise very great movie/TV content with very young kids. For example, StarTrek. They can call this feature "PGify" :).

There is (at least) one company providing this kind of services. They tag in the movie all the content with timestamps, and can provide it to a player to skip or not depending on the tag (nudity, violence, etc.). As far as I know, it was manual, but that was already a few years ago. I don't remember the name of the company, but surely it can be found and there are probably multiple such providers. The service was pro…

There was. The most well known was CleanFlicks. They were all sued into oblivion.

https://en.m.wikipedia.org/wiki/CleanFlicks

There's a documentary about it: https://m.imdb.com/title/tt1007026/

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#42

Post by elithrar »

speeq wrote: post #36

What would be the best way to moderate user generated video content / live streams? Take one frame per second and check it using these services? But that would get super expensive real quick ..

Many of the named providers offer video APIs for detecting this content. Will work out much cheaper than throwing every frame at the image APIs.

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#43

Post by phyller »

captainwhoreal wrote: post #16
sytelus wrote: post #14

This is very cool comparison. I would really like folks at Netflix/Amazon to take this and build a feature that auto-skips through non-PG rated content so you can watch some of otherwise very great movie/TV content with very young kids. For example, StarTrek. They can call this feature "PGify" :).

So the scenes where they kill each other are okay but God forbid a nipple? That's sick...

Pretty sure parent comment was specifically referring to violence as I don't recall explicit nudity in Star Trek movies (just suggested nudity).

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#44

Post by dharmab »

JazzXP wrote: post #26

Great write up. As a photographer, the more companies are relying on this the more frustrating the mis classification of SFW as NSFW is getting. I’ve copped a few Facebook bans from automated detection (I assume given how quickly the report comes in) for images totally within their community guidelines. A number of my photographer friends are in the same boat also. I counted at least 5 of us on 30 day bans in October…

Facebook uses human filters since their policy is not a simple "no nudity" one. For example, breastfeeding pictures are allowed.

https://www.wnycstudios.org/story/post-no-evil

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#45

Post by devonkim »

aadityaa wrote: post #8
zawerf wrote: post #4

If the nsfw images were from google search (or are images that could easily be indexed by google), it's not surprising that google is performing well on them. Presumably any low confidence images would've been manually tagged and re-added to their training set already.

Hey zawerf, your right. 2 notes. 1) it's very difficult to find nsfw images especially a particular kind like gore or suggestive nudity unless you Google things (which indicates a bigger problem). Maybe the solution is to use Bing (maybe this would cause the same issue in compariosn) or DuckDuckGo. But honestly I think if DuckDuckGo indexed a page, I'm pretty sure Google did as well. You would probably need something…

So one thing I did for a while was to take content from porn sites, extract key frames and any available images, and look for SFW images. Hard problems include detecting NSFW stuff that includes no nudity / genitalia (bodily fluids and solids) and correcting skin tone (most models being trained on primarily Caucasian and Asian performer data had trouble with darker skin tones). Some previous research showed that the trained CNNs were looking very hard for lipstick, so adding in samples from performers with less contrast on the lips was also important for training purposes. I didn’t notice anything terribly different when training with transgender performers (hotdog / not hot dog is very easy from an object detection basis) but I had to be sure that there wasn’t confusion that a human could have that would introduce bias into the model. Another big plus with porn sites is that your data is already tagged by its users and they are checked aggressively for accuracy.

My point is really that image searches can only get you so far and that biases are abound in casual NSFW searches to the extent you may need to curate your own data sets that look like they could be on a random porn site in ANY section. Finding an appropriate training set almost reminds me of jury selection processes.

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#46

Post by krupan »

tyingq wrote: post #41
cataflam wrote: post #27

Earlier quoted context omitted.

There is (at least) one company providing this kind of services. They tag in the movie all the content with timestamps, and can provide it to a player to skip or not depending on the tag (nudity, violence, etc.). As far as I know, it was manual, but that was already a few years ago. I don't remember the name of the company, but surely it can be found and there are probably multiple such providers. The service was pro…

There was. The most well known was CleanFlicks. They were all sued into oblivion. https://en.m.wikipedia.org/wiki/CleanFlicks There's a documentary about it: https://m.imdb.com/title/tt1007026/

More recently: VidAngel

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#47

Post by tyingq »

krupan wrote: post #46
tyingq wrote: post #41

Earlier quoted context omitted.

There was. The most well known was CleanFlicks. They were all sued into oblivion. https://en.m.wikipedia.org/wiki/CleanFlicks There's a documentary about it: https://m.imdb.com/title/tt1007026/

More recently: VidAngel

Hadn't seen that. Predictably, also being sued by multiple entities: http://blog.vidangel.com/category/legal/

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#48

Post by [deleted] »

devonkim wrote: post #45
aadityaa wrote: post #8

Earlier quoted context omitted.

Hey zawerf, your right. 2 notes. 1) it's very difficult to find nsfw images especially a particular kind like gore or suggestive nudity unless you Google things (which indicates a bigger problem). Maybe the solution is to use Bing (maybe this would cause the same issue in compariosn) or DuckDuckGo. But honestly I think if DuckDuckGo indexed a page, I'm pretty sure Google did as well. You would probably need something…

So one thing I did for a while was to take content from porn sites, extract key frames and any available images, and look for SFW images. Hard problems include detecting NSFW stuff that includes no nudity / genitalia (bodily fluids and solids) and correcting skin tone (most models being trained on primarily Caucasian and Asian performer data had trouble with darker skin tones). Some previous research showed that the…

[deleted]

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#49

Post by rixrax »

This comparison is a nice snapshot in time. Could this be developed towards the direction of Virustotal[0] where an image can be uploaded at any and all services would be compared. Combined with a 'reference' set of images that are periodically ran through all the services as to see how they improve/change in their capabilities over time.

[0] https://www.virustotal.com/

Re: Comparison of the Best NSFW Image Moderation APIs 2018

#50

Post by aadityaa »

miss_classified wrote: post #7

The Gore10 image isn't gore, unless there's something I don't know about going on. It appears to be a toy cartoon pet rat situated on top of some glossy rubbery plastic red toy prop slime guts. Whatever it is, or is supposed to be, it isn't an explicit or graphic depiction of real violence. Does that matter? I think so. Maybe it's not something to show a small child, and at a glance, one might develop the wrong impre…

Hey miss_classified I was pretty disturbed by most of these images. That images was no exception. Honestly till you pointed it out I had no clue. Anyway if it's safe for work or not that's debatable. Would I want my co-workers seeing this on my screen probably not. As I mentioned in the blog right at the end I'm more convinced after going through this exercise that it's difficult if not impossible for us to agree on what is and isn't safe for work.
Post reply on HN