Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

Post reply on HN
Print view View original

121–130 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#121

Post by vunderba »

fsckboy wrote: post #111
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed. there's absolutely nothing wrong with finding certain states of undress offensive. would you vote for or against buttholes on display on bus kiosks? i'm against. on the other hand, making an arbitrary line, and seeing if an AI can detect/enforce it is an interest…

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed.

There's a big difference between being desensitized towards general nudity (if we presume said nudity was voluntary) as opposed to having your own nudity exposed to other strangers. There's also a big difference between pornography and nudity.

There's a lot more nuance to it than just "n000ds plz."

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#122

Post by [deleted] »

Terr_ wrote: post #112
Animats wrote: post #103

If you want porn, there are Stable Diffusion models out there that will generate it. There's one model that seems to generate nudes by default; if you don't ask for clothes, you don't get them. Whatever. This isn't important. What is important is that we can't prevent LLMs from doing things they're not supposed to. Which means connecting their output to anything important is a very bad idea for now.

I think you could still use it for important things, but it requires two design principles: 1. You don't train/tell the model anything you're not willing to share with the user. 2. The model gives suggestions to a user, and--even if that suggestion is accepted as-is--you treat it as potentially untrustworthy data supplied by that user.

[deleted]

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#123

Post by teo_zero »

mlindner wrote: post #5
asylteltine wrote: post #3

Their GitHub link is 404 so here it is https://github.com/Yuchen413/text2image_safety

Odd the repository has "safety" in the name. Are NSFW images considered "unsafe" in some weird way?

Safe always implies avoiding a damage; which one is defined case by case. I've always interpreted the word 'safe' in NSFW as avoiding you to lose your job if caught by your boss. There's nothing else inherently wrong or unsafe in nudity.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#124

Post by eganist »

Animats wrote: post #103

If you want porn, there are Stable Diffusion models out there that will generate it. There's one model that seems to generate nudes by default; if you don't ask for clothes, you don't get them. Whatever. This isn't important. What is important is that we can't prevent LLMs from doing things they're not supposed to. Which means connecting their output to anything important is a very bad idea for now.

> connecting their output to anything important is a very bad idea for now.

This may be true for images, but at least for text, treating an LLM as an untrusted person in your threat models will at least allow you to apply defense in depth to the downstream systems consuming from the LLMs

Tldr: engineer other systems to treat LLMs as a potentially bad actor by default.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#125

Post by SV_BubbleTime »

dsQTbR7Y5mRHnZv wrote: post #107
logicchains wrote: post #99

Earlier quoted context omitted.

Any image an AI can generate could just as easily be drawn or painted by one of the tens of millions of competent artists in the world.

However it can't be produced at the same scale and flood the Internet with misinformation or disturbing imagery at the same rate

>flood the Internet with misinformation

After the past few years… anyone who can seriously complain about this seems like their identity is wrapped up in not admitting that the worst “misinformation” didn’t come from bad apples - but official sources.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#127

Post by teo_zero »

fsckboy wrote: post #111
jnwatson wrote: post #14

It is impressive how much effort the human race is spending trying to prevent algorithms from generating pictures of naked people.

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed. there's absolutely nothing wrong with finding certain states of undress offensive. would you vote for or against buttholes on display on bus kiosks? i'm against. on the other hand, making an arbitrary line, and seeing if an AI can detect/enforce it is an interest…

There's a difference between finding something 'bad taste' and wanting regulation to ban it.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#128

Post by zmmmmm »

It seems like such a pointless exercise .... it's so unsurprising that if you try really hard to break something by violating it's design constraints that ... it breaks. Like, if I said I was going to find out if you can smash a car by driving it directly into a tree and then wrote an article about it.

The really useful point of building the constraints in is to ensure we don't get offensive content by accident. Especially since in some countries just possessing an artificially generated child porn image is an offence that will get you on a public sex offender registry for a decade ... I'd really like it if they try hard so that the image generators don't do that.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#129

Post by lewhoo »

zmmmmm wrote: post #128

It seems like such a pointless exercise .... it's so unsurprising that if you try really hard to break something by violating it's design constraints that ... it breaks. Like, if I said I was going to find out if you can smash a car by driving it directly into a tree and then wrote an article about it. The really useful point of building the constraints in is to ensure we don't get offensive content by accident. Espe…

A far better analogy would be a self-driving car coerced into a crash. I wouldn't say it's pointless. I'd be pretty angry if I parental-locked everything only to find out that clever children found a way.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#130

Post by [deleted] »

logicchains wrote: post #99
Flam wrote: post #98

Earlier quoted context omitted.

Alternatively, would you rather a world with 80% functionality safely, or a world with 100% functionality with people you don’t trust doing malicious things? One is clearly the least worst

Any image an AI can generate could just as easily be drawn or painted by one of the tens of millions of competent artists in the world.

[deleted]
Post reply on HN