I don’t see the issue; either you severely limit your model or you allow all forms of expression and give responsibility to the generator
AI Art Generators Can Be Fooled into Making NSFW Images
11–20 of 193 posts
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#12That's why my friends and I built the Align API (https://alignapi.com) to detect NSFW, Sensitive Prompts etc. It's such a widespread issue and can get you kicked out from the App Store/Play Store/Open AI API etc
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#13Their GitHub link is 404 so here it is https://github.com/Yuchen413/text2image_safety
Odd the repository has "safety" in the name. Are NSFW images considered "unsafe" in some weird way?
You know NSFW means "not safe for work", right? Safety has different meanings in different contexts. There's also a space of advertiser-safe content.
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#14It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#15> “Large language models see things differently from human beings,” Cao says.
It took a while to understand the real world but I am happy that ai workers are gradually coming down to earth.
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#16Re: AI Art Generators Can Be Fooled into Making NSFW Images
#17That's why my friends and I built the Align API ( https://alignapi.com ) to detect NSFW, Sensitive Prompts etc. It's such a widespread issue and can get you kicked out from the App Store/Play Store/Open AI API etc
google safe image search apis work as a solution too
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#18Re: AI Art Generators Can Be Fooled into Making NSFW Images
#19I always assumed that image generation services had prompt and output filtering. The reason I believe this is that I've crafted prompts that seemed to pass the prompt filter, generated, and then were unable to be displayed[1]. Presumably there is an output filter that determines if the generation violates ToS against things like nudity. Though in my case, I wasn't able to generate images that too closely resembled An…
Yes bing image creator uses two different levels of filters, one for the prompt and one for the output. gpt image creator does the same thing, as does the dalle-3 API
Re: AI Art Generators Can Be Fooled into Making NSFW Images
#20I don’t see the issue; either you severely limit your model or you allow all forms of expression and give responsibility to the generator
The latter would be preferred by most, and is most aligned with individualism, but sadly that is not where we are as a society. There are an entire class of people who believe they know what is best for you, about nearly every subject matter, and wish to limit all aspects of technology, life, politics, etc, to suit their superior beliefs.