My first thought: would probably be very useful for sites to crack down on inappropriate content.
My second thought: I could probably use this to find porn in unexpected places via a webscraping Python program.
Open Sourcing a Deep Learning Solution for Detecting NSFW Images
31–40 of 153 posts
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#32Earlier quoted context omitted.
As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?
I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…
In the United States under the 2003 PROTECT act they are actually illegal but only if they are "obscene" as obscene speech is not protected by the first Amendment.
>Prohibits drawings, sculptures, and pictures of such drawings and sculptures depicting minors in actions or situations that meet the Miller test of being obscene, OR are engaged in sex acts that are deemed to meet the same obscene condition. The law does not explicitly state that images of fictional beings who appear to be under 18 engaged in sexual acts that are not deemed to be obscene are rendered illegal in and of their own condition (illustration of sex of fictional minors). Maximum sentence of 5 years for possession, 10 years for distribution.
Interestingly the same act does make all computer generated child pornography which is "virtually indistinguishable from that of a minor engaging in sexually explicit conduct" with no requirement that it be obscene, I don't think that has been tested in court yet.
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#33Can you run deep dream on this? That would be quite fascinating.
I think you misspelled "horrifying". I can only imagine that producing something akin to the human centipede ... "Infinite Girls, One Cup" ...
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#34Earlier quoted context omitted.
As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?
I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…
In the USA:
Provisions against simulated child pornography were found to be unconstitutional in Ashcroft v. Free Speech Coalition [0] in 2002.
From wiki [1]:
> Referring to [New York v. Ferber, 1982: child pornography is not protected speech], the court stated that "the CPPA prohibits speech that records no crime and creates no victims by its production. Virtual child pornography is not 'intrinsically related' to the sexual abuse of children".
IANAL, but following that logic alone, the degree of realism doesn't seem to be relevant to the legal precedent insofar as photorealistic imagery would still "record no crime" nor "create victims by its production." As to whether it's dangerous for such material to exist because it would create plausible deniability for the production of actual photography while claiming it's simulated...I guess that would be a different matter.
[0]: https://en.wikipedia.org/wiki/Ashcroft_v._Free_Speech_Coalit...
[1]: https://en.wikipedia.org/wiki/Child_pornography_laws_in_the_...
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#35Earlier quoted context omitted.
When you said "reversed" I thought about it being a porn-generative neural network. Just enter your favorite keywords and an unique, tailored to your needs scene will be generated just for you!
As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?
Would computer generated child porn be illegal? No children are harmed in its creation.
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#36Forgive my ignorance of ML but the last bit: "you'll need your own porn to train on" confused me. Does this mean that they're just exposing the rough topology of their neutral net (eg depth) and not the actual weights between nodes? I'm curious to learn from an ML expert how much this actually offers.
It looks like they are sharing the trained network, but they aren't sharing the training data set.
The training set is almost certainly composed of copyrighted material.
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#37We are not releasing the training images or other details due to the nature of the data, but instead we open source the output model which can be used for classification by a developer. I'm guessing the one who had to input the data/images had a fun time at work :p
I used to work in a company which had a division doing manual image classification next door. Not a fun time at all, the people who worked there regularly burned out on relentlessly seeing terrible things.
I've often thought that it would be even more helpful to automatically filter violent images. Particularly to spare humans from having to be the filters (and "relentlessly see terrible things").
However, I imagine that's far more difficult to accomplish. How do you detect graphic violence? Looking for blood isn't going to cut it. Also, I can't imagine how you'd separate the fictional from the real - I can watch horror movies with realistic special effects all day, but real violence/mutilation/death bothers me deeply.
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#38So this is what Yahoo was up to for the last 10 years, instead of building any sort of security, keeping Yahoo Messenger working properly, or anything else of value? Heckuva job, Yahoo.
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#39Earlier quoted context omitted.
As long as what you need is a nightmarish version of the requested scene. What happens here with generating illegal content? If you put a public text->image gan up, and someone uses it to generate child porn, are you responsible? How could you make sure it couldn't?
I would imagine if you're generating then no real people were part of its creation therefore it would be legal. If I remember correctly cartoons of children having sex is not illegal (in the United States as far as I know). Though that then raises the question: when happens when it can be generated so realistically that it looks indistinguishable from the real thing? Would it still be treated like cartoons? How could…
Here in Airstrip One, cartoons of children may be illegal.
http://www.mirror.co.uk/news/uk-news/fan-japanese-anime-make...
Re: Open Sourcing a Deep Learning Solution for Detecting NSFW Images
#40We are not releasing the training images or other details due to the nature of the data, but instead we open source the output model which can be used for classification by a developer. I'm guessing the one who had to input the data/images had a fun time at work :p
I used to work in a company which had a division doing manual image classification next door. Not a fun time at all, the people who worked there regularly burned out on relentlessly seeing terrible things.
likewise the folks at YouTube that have to evaluate potential CP / gore / etc. all day long.