Live data from Hacker News

Open Sourcing a Deep Learning Solution for Detecting NSFW Images

yahooeng.tumblr.com

41–50 of 153 posts

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#41
post #22

Earlier quoted context omitted.

As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?

Would computer generated child porn be illegal? No children are harmed in its creation.

Yes. Whether that is a good idea should probably not be debated here, as it will lead to a 500-comment subthread.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#42
post #22

Earlier quoted context omitted.

As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?

Would computer generated child porn be illegal? No children are harmed in its creation.

No

" (8) “child pornography” means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where— (A) the production of such visual depiction involves the use of a minor engaging in sexually explicit conduct; (B) such visual depiction is a digital image, computer image, or computer-generated image that is, or is indistinguishable from, that of a minor engaging in sexually explicit conduct; or (C) such visual depiction has been created, adapted, or modified to appear that an identifiable minor is engaging in sexually explicit conduct.

...

(11) the term “indistinguishable” used with respect to a depiction, means virtually indistinguishable, in that the depiction is such that an ordinary person viewing the depiction would conclude that the depiction is of an actual minor engaged in sexually explicit conduct. This definition does not apply to depictions that are drawings, cartoons, sculptures, or paintings depicting minors or adults. "

In theory, you could argue that the network was trained on child porn, and as such anything produced by it involved the use of a minor engaging in sexually explicit conduct; but I can't imagine a court actually buying that arguement.

https://www.law.cornell.edu/uscode/text/18/2256

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#44
post #16

Earlier quoted context omitted.

It looks like they are sharing the trained network, but they aren't sharing the training data set.

The training set is almost certainly composed of copyrighted material.

Interesting thought - doesn't every single porn producer now have a valid copyright claim on the trained network? I don't see how you can argue this isn't a derivative work based on the movies they produced.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#45
Good to see they've automated this (beyond the initial classification of training data). In the early days of the web, such filters were typically based on manually maintained lists of sites. I actually met someone at a party once whose full-time job was to surf for porn, to maintain the filter for a provider of IT services to schools (he worked for a company now called RM Education). He said it was his ideal job for the first few days, but soon grew tiresome (note that back in those days there wasn't really any extremely objectionable material on the web).

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#46

Earlier quoted context omitted.

I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…

In the USA: Provisions against simulated child pornography were found to be unconstitutional in Ashcroft v. Free Speech Coalition [0] in 2002. From wiki [1]: > Referring to [New York v. Ferber, 1982: child pornography is not protected speech], the court stated that "the CPPA prohibits speech that records no crime and creates no victims by its production. Virtual child pornography is not 'intrinsically related' to the…

They actually fixed this with the 2003 PROTECT act which only makes obscene simulated child pornography illegal. Because obscenity isn't protected by the first amendment this has been found to be constitutional.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#47
post #24

Sit back grab some popcorn. Lets see how long it takes people to start running data backwards to get new original porn.

I see you never have seen what kind of images that tends to generate. Or you're really into R'lyehian porn.

>Or you're really into R'lyehian porn.

It's called tentacle hentai...

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#49
post #44

Earlier quoted context omitted.

The training set is almost certainly composed of copyrighted material.

Interesting thought - doesn't every single porn producer now have a valid copyright claim on the trained network? I don't see how you can argue this isn't a derivative work based on the movies they produced.

I don't think it's a derivative work just because one of the inputs is copyrighted. I think it's more descriptive than derivative. Content producers don't generally own copyright in critics' descriptions of their movies or of plot summaries, even though their copyrighted material is a necessary input to the description's creation.

Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images

#50
post #44

Earlier quoted context omitted.

The training set is almost certainly composed of copyrighted material.

Interesting thought - doesn't every single porn producer now have a valid copyright claim on the trained network? I don't see how you can argue this isn't a derivative work based on the movies they produced.

Except the 'derivative' has nothing in common with the original.
Post reply on HN