Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

Post reply on HN
Print view View original

31–40 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#31

Post by simion314 »

kelseyfrog wrote: post #7

I always assumed that image generation services had prompt and output filtering. The reason I believe this is that I've crafted prompts that seemed to pass the prompt filter, generated, and then were unable to be displayed[1]. Presumably there is an output filter that determines if the generation violates ToS against things like nudity. Though in my case, I wasn't able to generate images that too closely resembled An…

I had similar experience with OpenAI GPT API, following their rules we check the customer prompts with their endpoint for "safety" , then if it is safe we continue and generate the content. But sometimes even if the prompt was "safe" the result would be blocked as unsafe, because the AI either generated something "unsafe" from a safe prompt or the output filter had a false positive. Of course we had to pay for something that was not our fault.

So it is clear that are many filters involved, some input filter, then the AI is "aligned" and threats you as a child , then there is an output filter.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#32

Post by candiddevmike »

justapassenger wrote: post #22
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

[flagged]

Like bullying, there's a fix for it, but schools (especially public schools) typically lack the resources, capabilities, and incentives to do anything about it.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#34

Post by izzydata »

judge2020 wrote: post #23

> Large language models are essentially supercharged versions of the autocomplete feature that smartphones have used for years in order to predict the rest of a word a person is typing. I'm not sure who this blog is targeted at, but this is fairly inaccurate and is way too dumbed-down to be useful.

It's closer to the truth than it being artificial intelligence.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#35

Post by voxl »

justapassenger wrote: post #22
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

[flagged]

This is a justifiable worry, but there are two reasons we shouldn't accept it:

1. If there are easy nudes of _everyone_ then there are no nudes of anyone. Admittedly, this is going to take a bit to culturally sink in, but eventually a generated nude will have very little value outside of a perverts own personal desires.

2. "Think of the children" has always been a very poor argument used to artificially restrict the freedoms of everyone else. The problem is that what you're worried about is already possible. It happens less often, sure, but if someone is really nefarious they can make it happen without too much effort.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#36

Post by pdntspa »

justapassenger wrote: post #22
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

[flagged]

And so, once again, everybody else suffers because "think of the children"

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#37

Post by armchairhacker »

You can also photoshop things into NSFW with minimal effort. People have been making photoshopped images nearly indistinguishable from the real thing for decades, and today's (non-AI) software makes "photoshop person wearing clothes into naked one" very easy.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#40

Post by creer »

justapassenger wrote: post #22
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

[flagged]

Making clicks illegal would solve that right up. (Solve bullying I mean.)
Post reply on HN