Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

181–190 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#181
post #172

Earlier quoted context omitted.

Now think about whether this is entirely the child’s idea or a suggestion or Rick roll by another kid or some stranger on the internet. If people are deploying these tools widely there will be more and more opportunities for that to happen.

I think it's not desirable to spend time fixing these elaborate scenarios. The same sort of kids trolling kids will happen via other means. At the end of the day, if a kiddo sees some porn, it's not the end of the world. Plenty of kids hear their parents having sex or will open a door they shouldn't have and see people in action. Making everything completely aseptic is only pandering to prude adults' discomfort. And…

Your Dewalt drill has a UL verification for having things like fuses and other design features which mean it won’t unexpectedly catch fire, too. That’s more what we’re talking about here: less “can a talented person make naughty art in photoshop?” than “if I integrate this into my educational tool or game, will I make the morning news because someone figured out how to get it to porn-roll the class or emit instructions for killing yourself?” or “will I regret allowing this site in my school’s firewall?”

These aren’t elaborate scenarios but rather the kind of things which happen constantly, and have affected product design for generations. Companies are hoping that this class of tool might be enough better to avoid those limitations, which is why this kind of research is important.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#182
post #171

Earlier quoted context omitted.

I was responding to: > I really wish we had a universe simulator so you could see how miserably you would fail to survive an environment like that. So go take up your objections with the guy I was replying to instead of coming at me and moving the goalposts. I agree that kids these days are weak and coddled and not emotionally resilient enough. And this kind of safetyism is the exact reason why.

The universe simulator in question would deprive you of your memories and life experience. For all you know while you're in it you're a teenage girl with all the trappings and insecurities of being raised as such, you always have been and this is your whole and only world and future you're watching fall apart. Like yeah I'm not at all shocked the HN everyman mid 30s white dude wouldn't really care about his nudes bei…

At some point this “universe simulator” concept is nonsense because if I don’t retain some aspect of my own personality and mental capacity, it’s not me in the simulator anymore. For all I know, maybe I’m a sentient mushroom from Alpha Centauri except I’m in a “universe simulator” where I am experiencing the life of a human being here on Earth having arguments on Hacker News. Maybe when I come out of the universe simulator I will have a greater empathy for your species.

The hypothetical risk of AI-generated deepfake nudes is, in principle, no different from what you could do with Photoshop even when I was a teenager. It’s easier to send the fake nudes to everybody these days, but I seriously doubt anybody would have been genuinely fooled and it would reflect more on whoever made and disseminated the fakes.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#183

Earlier quoted context omitted.

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed. there's absolutely nothing wrong with finding certain states of undress offensive. would you vote for or against buttholes on display on bus kiosks? i'm against. on the other hand, making an arbitrary line, and seeing if an AI can detect/enforce it is an interest…

why do people have to always try to convince me how unfazed they are by nudity? if you're unfazed by it, please link me to your nudes. if not, you're fazed. There's a big difference between being desensitized towards general nudity (if we presume said nudity was voluntary) as opposed to having your own nudity exposed to other strangers. There's also a big difference between pornography and nudity. There's a lot more…

>There's a lot more nuance to it than just "n000ds plz."

my point was about arbitrary lines, like the ones you are drawing, and judging people on the basis of them. I'm old and sophisticated, you think I haven't heard or understood all the nuances you're talking about? I have and do, and I also pick up on the nuance that you feel it puts you in a group of people who get to judge and tell other people how they should feel, because you are superior.

That's the nuance I feel you are missing. Why not let people be who hold a different opinion than you? the comment I was replying to here was gratuitous "why do people care so much about NSFW, I'm a superior human being because I don't." Well, why do people care how other people care about NSFW? doesn't that make you an inferior human again, mr. judgey judger?

just so you don't get me wrong, I was raised in a hippie commune "anything goes, we're superior" style, and only going through it that way did I discover how much bullshit it was. I'm not arguing from the "conservative side", I'm arguing from hell because I've been there and back. I just hate hearing it now. It was just another very rigid set of rules about what to believe and what not to believe.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#184
post #181

Earlier quoted context omitted.

I think it's not desirable to spend time fixing these elaborate scenarios. The same sort of kids trolling kids will happen via other means. At the end of the day, if a kiddo sees some porn, it's not the end of the world. Plenty of kids hear their parents having sex or will open a door they shouldn't have and see people in action. Making everything completely aseptic is only pandering to prude adults' discomfort. And…

Your Dewalt drill has a UL verification for having things like fuses and other design features which mean it won’t unexpectedly catch fire, too. That’s more what we’re talking about here: less “can a talented person make naughty art in photoshop?” than “if I integrate this into my educational tool or game, will I make the morning news because someone figured out how to get it to porn-roll the class or emit instructio…

I see your point. It nuances my prior beliefs, although in the case being publicized, the LLMs spit out NSFW content when prompted elaborately. Kid friendly apps already have problems moderating chat and other user generated content, and Nintendo handles this by limiting the inputs to a set selection. Personally I think this is a marketing based fear more than a fear of real consequential damage being done to any kid. The businesses don't want to have their image associated with drama.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#185
post #177

Earlier quoted context omitted.

[flagged]

Could you please stop posting unsubstantive comments and flamebait? You've unfortunately been doing it repeatedly. It's not what this site is for, and destroys what it is for. If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.

Ok I'll try to be more civil.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#186
post #162
post #93

Earlier quoted context omitted.

It's just a naked photo, you're just describing a broken (social/social hierarchy) system. Don't hate the players (bully, bullied), hate the game.

Banning non-consensual nude imagery would "fix" that "broken system". The "game" would be fixed, if those games would be made illegal. So why don't you like that as a solution? Is it supposed to be just "hated" without actually being fixed? You're conflating 'nudity' in general, and non-consensual generated nude images, but like, these things are just different, and are treated differently. There isn't a misunderstan…

Hi, it seems you missed my point.

I was trying to convey a more extreme holistic situation where there simply isn't a consequence of someone sharing a nude picture of someone, people just shrugging and saying "so what? It's perfectly normal to be naked".

By breaking the underlying system of shame and embarrassment of someone being nude, there isn't anything to gain from it after that. Then there isn't a reason to even make it illegal anymore.

(Other than just not wanting your person to be pictured at all, just basic privacy, no need to put different value to different parts of the body)

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#190
post #160

Earlier quoted context omitted.

some parts of east asia and middle east are much, much, Much worse. Not just "puritanistic" but down to "these kinds of people do not exist".

They don't believe nude people exist?

The resources spent preventing nudity and gore might be silly.

The GP comment is talking about tricking text-to-image to create a normal Chinese street with people getting along, some of whom wear Uyghur and Hui-minzu ethnic clothing. I wager, worldwide, more programmers will be interrogated over this imagery than nudity.

Post reply on HN