Live data from Hacker News

Open Sourcing a Deep Learning Solution for Detecting NSFW Images

yahooeng.tumblr.com

91–100 of 153 posts

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#92

Earlier quoted context omitted.

It's hard to say that changed anything. Obscenity is a notoriously thorny subject in American constitutional law. The legal test for determining obscenity[0] is highly subjective and in the context of the internet very difficult to apply. [0] https://en.wikipedia.org/wiki/Miller_test

Highlights from: https://en.wikipedia.org/wiki/Miller_test The test: * Whether "the average person, applying contemporary community standards", would find that the work, taken as a whole, appeals to the prurient interest, * Whether the work depicts or describes, in a patently offensive way, sexual conduct or excretory functions specifically defined by applicable state law, * Whether the work, taken as a whole, lacks…

I think the technical feats involved in creating such a text-to-image program might allow a talented laywer to make an argument for scientific value.

There's also the issue that "contemporary community standards" are hard to determine, because what community you're talking about is hard to determine.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#93
post #77

Earlier quoted context omitted.

>How could you make sure it couldn't? I just realized the answer to this is pretty obvious, you could have a network trained to classify child pornography and use it to censor the output. Getting the training set would be an issue, you would probably have to work with law enforcement to do it.

Impossible. There is no accurate way to determine age by external appearance. For example a 15 year could look older than an 18 year old.

If it's being generated no characters actually have an age.

Any that are plausibly adults would presumably be legally in the clear.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#95

Earlier quoted context omitted.

I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…

In the USA: Provisions against simulated child pornography were found to be unconstitutional in Ashcroft v. Free Speech Coalition [0] in 2002. From wiki [1]: > Referring to [New York v. Ferber, 1982: child pornography is not protected speech], the court stated that "the CPPA prohibits speech that records no crime and creates no victims by its production. Virtual child pornography is not 'intrinsically related' to the…

While no one was harmed in the direct creation of a generated video, can it not be argued that in order to train such a generative engine, it is highly likely that harm-inducing content was produced/consumed at some stage?

Where does the harm boundary lie? Is harm inflicted if an inanimate object is the only thing consuming the content? Is a generated video borne from harmful content an interest payment on your harm-capital?

Meta, but interesting I wonder whether this train of thought would hold in a court of law...

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#96

So can it be reversed to become the ultimate porn-finding neural network?

You can use the nsfw subreddits as a massive dataset for categorizing porn.

Not all of them. gonwild[1] is a just a massive polygon pun subreddit

[1] https://www.reddit.com/r/gonwild

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#97

Earlier quoted context omitted.

Yes. Whether that is a good idea should probably not be debated here, as it will lead to a 500-comment subthread.

Who doesn't love a 500-comment subthread?!

Snowwrestler, who likes to make comments then tells everyone else not to

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#100

They acknowledge that NSFW (or pornographic) is hard to define, a la 'I recognize it if I see it'. But looking at the meager 3 sample images I'm confused about the scoring already. Why is the one in the middle scoring the highest? The question is an honest one. The two rightmost images seem to be interchangeable to me and are ~boring~: People at the beach. Is this network therefor already trained to include the biase…

All ML networks are inherently biased towards its creators. My colleague recently described this issue to me as the "Old, white, male" problem. This is why most voice recognition services drastically fail when they are shown foreign accents.
Post reply on HN