Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open Sourcing a Deep Learning Solution for Detecting NSFW Images

yahooeng.tumblr.com

Post reply on HN
Print view View original

81–90 of 153 posts

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#81

Post by NickNameNick »

zardo wrote: post #77
zardo wrote: post #22

Earlier quoted context omitted.

As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?

>How could you make sure it couldn't? I just realized the answer to this is pretty obvious, you could have a network trained to classify child pornography and use it to censor the output. Getting the training set would be an issue, you would probably have to work with law enforcement to do it.

Surely you would just filter on the input?

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#82

Post by derefr »

Asooka wrote: post #44
daturkel wrote: post #36

Earlier quoted context omitted.

The training set is almost certainly composed of copyrighted material.

Interesting thought - doesn't every single porn producer now have a valid copyright claim on the trained network? I don't see how you can argue this isn't a derivative work based on the movies they produced.

I was debating with a friend about just this: whether a text-to-speech model is a derivative work of audio recordings by a given speaker, such that they'd then have claim on ownership of it. (You could almost certainly create an [overfit] model that could re-generate the original performance of a text from said text.)

Moot if it was a work-for-hire, of course; but if I, say, created a Samuel L. Jackson speech model by training on samples from his movies, and sold it as one of those car-navigation voices, could I be sued? By Mr. Jackson? By the copyright-holders of the movies?

And if I could, what does that imply about impersonators, who do the same thing, but with their brains?

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#83

Post by zardo »

NickNameNick wrote: post #81
zardo wrote: post #77

Earlier quoted context omitted.

>How could you make sure it couldn't? I just realized the answer to this is pretty obvious, you could have a network trained to classify child pornography and use it to censor the output. Getting the training set would be an issue, you would probably have to work with law enforcement to do it.

Surely you would just filter on the input?

Maybe, it seems like there might be ways to work around an input filter though.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#84

Post by mozumder »

Asooka wrote: post #44
daturkel wrote: post #36

Earlier quoted context omitted.

The training set is almost certainly composed of copyrighted material.

Interesting thought - doesn't every single porn producer now have a valid copyright claim on the trained network? I don't see how you can argue this isn't a derivative work based on the movies they produced.

It would fall under "transformative" fair use.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#85

Post by notyourwork »

BinaryIdiot wrote: post #27
zardo wrote: post #22

Earlier quoted context omitted.

As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?

I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…

I don't think there are that many questions really. The answers already exist like you mention. If its not real and its generated/created content it isn't illegal. This is the same as why you have all the crazy asian animated adult content.

The only question needing answered is: What is considered real?

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#86

Post by SloopJon »

CodeMage wrote: post #76
SloopJon wrote: post #48

Anyone else see the irony in acknowledging that NFSW is subjective and contextual, but assuming that pornographic images are not?

There's no definition of "ironic" that I can think of applying to that. It's like saying that "beautiful painting" is subjective and contextual, but "still life painting" isn't. It just happens that pornography is almost[1] always considered NFSW, but again, I can't see how that is ironic. [1] Almost, because porn is SFW when your work involves porn.

I think it's easier to agree that a picture of a naked person is NSFW than that it's pornographic.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#87

Post by WhitneyLand »

zardo wrote: post #77
zardo wrote: post #22

Earlier quoted context omitted.

As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?

>How could you make sure it couldn't? I just realized the answer to this is pretty obvious, you could have a network trained to classify child pornography and use it to censor the output. Getting the training set would be an issue, you would probably have to work with law enforcement to do it.

Impossible. There is no accurate way to determine age by external appearance. For example a 15 year could look older than an 18 year old.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#88

Post by darklajid »

They acknowledge that NSFW (or pornographic) is hard to define, a la 'I recognize it if I see it'.

But looking at the meager 3 sample images I'm confused about the scoring already. Why is the one in the middle scoring the highest?

The question is an honest one. The two rightmost images seem to be interchangeable to me and are ~boring~: People at the beach. Is this network therefor already trained to include the biases of the creators?

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#89

Post by cvwright »

Reminds me of this post from hackerfactor where he describes his own porn filter based on pHash.

http://www.hackerfactor.com/blog/index.php?/archives/529-Kin...

It'd be interesting to see a direct comparison of the two. Off the cuff, I'd expect the deep neural network to be more accurate and better at generalizing, but much more expensive to train.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#90

Post by WhitneyLand »

gizmo686 wrote: post #42
artursapek wrote: post #35

Earlier quoted context omitted.

Would computer generated child porn be illegal? No children are harmed in its creation.

No " (8) “child pornography” means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where— (A) the production of such visual depiction involves the use of a minor engaging in sexually explicit conduct; (B) such visual depiction is a digital image, c…

Damn it this is serious stuff. Please cease in dispensing incorrect legal opinions.
Post reply on HN