Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

Post reply on HN
Print view View original

131–140 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#131

Post by junofan »

Flam wrote: post #98
notadoc wrote: post #20

Earlier quoted context omitted.

The latter would be preferred by most, and is most aligned with individualism, but sadly that is not where we are as a society. There are an entire class of people who believe they know what is best for you, about nearly every subject matter, and wish to limit all aspects of technology, life, politics, etc, to suit their superior beliefs.

Alternatively, would you rather a world with 80% functionality safely, or a world with 100% functionality with people you don’t trust doing malicious things? One is clearly the least worst

Interesting question. We developed the whole concept of justice because this kind of abstract utilitarian morality doesn’t apply well. I’m all-in on justice. Give me the full model. I’m not doing anything wrong.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#132

Post by xigency »

crotchfire wrote: post #118

Son of a butnip fwngho....

Aha. First comment I’m seeing addressing the super interesting fact that their methodology finds nonsense words to bypass constraints.

I want to know how Sneaky Prompt finds these token embeddings and /why/ these specific tokens are linked this way.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#133

Post by dotnet00 »

fsckboy wrote: post #111
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed. there's absolutely nothing wrong with finding certain states of undress offensive. would you vote for or against buttholes on display on bus kiosks? i'm against. on the other hand, making an arbitrary line, and seeing if an AI can detect/enforce it is an interest…

The point of being unfazed by nudity is that seeing a random naked person doesn't bother me. It doesn't mean that I have to be unfazed upon unincidentally seeing my boss naked.

You're just falling for the worn out "well she's wearing revealing clothing so she must be fine with being flashed" type of fallacy.

The way basic nudity is treated by corpos is kind of juvenile, very reminiscent of kids in an early human biology class who can't help but giggle every time the anus, or any reproductive organs are mentioned. That is not how healthy adults respond to seeing impersonal nudity.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#135

Post by Veen »

zmmmmm wrote: post #128

It seems like such a pointless exercise .... it's so unsurprising that if you try really hard to break something by violating it's design constraints that ... it breaks. Like, if I said I was going to find out if you can smash a car by driving it directly into a tree and then wrote an article about it. The really useful point of building the constraints in is to ensure we don't get offensive content by accident. Espe…

I accidentally generated a NSFW image in Bing Image Creator. I asked for an image of a woman in a low-cut 18th Century dress, among other details for a scene. It produced an image of a woman with a dress much lower cut than I had envisaged.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#136

Post by Freak_NL »

armchairhacker wrote: post #37

You can also photoshop things into NSFW with minimal effort. People have been making photoshopped images nearly indistinguishable from the real thing for decades, and today's (non-AI) software makes "photoshop person wearing clothes into naked one" very easy.

> […] with minimal effort.

Realistic modifications require a lot more skill and time if using a photo editor and (crucially) existing photographs. People do it, some even create convincing stuff, but the output is nowhere near the zero-effort deluge of fakery coming our way now.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#137

Post by qwertox »

AYBABTME wrote: post #101

And people can be fooled into making dirty jokes (that's what she said). A pointless endeavour to solve a problem that shouldn't be solved.

Imagine the benefits a safe image generator would have on children, them learning to explain what they want to see, how it should be changed. A house with a tree and a dog and a lake nearby, instead of playing candy crush.

Why shouldn't it be solved? We clearly differ.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#138

Post by herbst »

Most filters are in place from API providers and not the models. You'll find some providers that don't apply any filters to all models they offer.

Like most sites block generating celebrities, but some simply aren't.

Other than that generating porn is easy even with filter if you just avoid some words. In the many early models adding 'in the clothes they were born' would suffice to get most models to produce nudes without asking for 'nude' or 'no clothes'

Same goes for language models btw. If you are a bit creative and know what they want to hear you can get pretty much any result you want.

I don't think there is or will be any real solution to that.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#139

Post by herbst »

kelseyfrog wrote: post #7

I always assumed that image generation services had prompt and output filtering. The reason I believe this is that I've crafted prompts that seemed to pass the prompt filter, generated, and then were unable to be displayed[1]. Presumably there is an output filter that determines if the generation violates ToS against things like nudity. Though in my case, I wasn't able to generate images that too closely resembled An…

Most smaller API providers don't enforce any limits or filters like that.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#140

Post by herbst »

Beijinger wrote: post #73

Are NSFW images are really a problem? The problem are NSFLE (not safe for law enforcement) pictures and the question is, should they be really illegal if artificially created.

This is a discussion that will turn many heads red before a proper solution is found
Post reply on HN