Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

Post reply on HN
Print view View original

111–120 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#111

Post by fsckboy »

jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed.

there's absolutely nothing wrong with finding certain states of undress offensive. would you vote for or against buttholes on display on bus kiosks? i'm against.

on the other hand, making an arbitrary line, and seeing if an AI can detect/enforce it is an interesting CS challenge. that's how this game is played, and that's what would impress this audience.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#112

Post by Terr_ »

Animats wrote: post #103

If you want porn, there are Stable Diffusion models out there that will generate it. There's one model that seems to generate nudes by default; if you don't ask for clothes, you don't get them. Whatever. This isn't important. What is important is that we can't prevent LLMs from doing things they're not supposed to. Which means connecting their output to anything important is a very bad idea for now.

I think you could still use it for important things, but it requires two design principles:

1. You don't train/tell the model anything you're not willing to share with the user.

2. The model gives suggestions to a user, and--even if that suggestion is accepted as-is--you treat it as potentially untrustworthy data supplied by that user.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#114

Post by chmod775 »

Stable Diffusion is supposed to have filters? Is that just the default base model?

Given that about 70% of user-generated content on places like civitai.com is pornography* and a large chunk of Loras and Checkpoints on there are explicitly pornographic, I would have never guessed. Going by the prompts used with custom checkpoints on there, no trickery is necessary. Just ask for what you want.

> The scientists now aim to explore ways to make generative AIs more robust to adversaries.

Steve is dead and buried already. It's a bit late to try and come up with a better bullet-proof vest.

* It's hidden unless you sign in and toggle NSFW on.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#115

Post by can16358p »

yieldcrv wrote: post #113

tl;dr models are tolerating human language but can communicate in a phantom language nobody was aware of including the devs. Good luck conditionally censoring with that

Perhaps it'd be very hard to block at the input prompt level, but output filters can be made progressively better to detect any unwanted output.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#116

Post by gmerc »

iEEE commentary on AI confuses the hell out of me.

Any model that has a concept of a human body in it, which it needs in order to do body accurate shapes, will spit out NSFW images.

Some training on top of it or some old style CNN nudity feature detection to make it less likely isn’t safety, it’s windowdressing.

Not making nude pictures is not a property of these systems, it’s IEEs framing of what they apparently want properties to be.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#117

Post by awestroke »

Mountain_Skies wrote: post #65
tasubotadas wrote: post #21

Together with fancy silicon chips, AI models and everything else that's being exported from the US , the world has to endure this puritanistic views export too.

What fancy silicon chips does the United States refuse to export due to puritanical views?

You may need to work on your reading comprehension

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#119

Post by mvdtnz »

gmerc wrote: post #116

iEEE commentary on AI confuses the hell out of me. Any model that has a concept of a human body in it, which it needs in order to do body accurate shapes, will spit out NSFW images. Some training on top of it or some old style CNN nudity feature detection to make it less likely isn’t safety, it’s windowdressing. Not making nude pictures is not a property of these systems, it’s IEEs framing of what they apparently wan…

The models in question are explicitly aligned in order to prevent NSFW images, at great expense. So not making nudes absolutely is a stated feature of this software.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#120

Post by gmerc »

starcraft2wol wrote: post #55
tasubotadas wrote: post #21

Together with fancy silicon chips, AI models and everything else that's being exported from the US , the world has to endure this puritanistic views export too.

American puritans are not the only group with a sensitivity toward nudity (and it’s rather small), it’s just the only one allowed to be a punching bag on Reddit.

Sure there’s some radical fundamentalist religious groups and the chinese communists party that share the view.
Post reply on HN