Live data from Hacker News

AI Art Generators Can Be Fooled into Making NSFW Images

spectrum.ieee.org

101–110 of 193 posts

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#102

So I've been wondering lately it seems there is a lot of effort going into making sure people can't generate NSFW images, but I wonder if a lot of this outrage isn't from the tech side (they tend to be fairly open about that stuff) but rather if it is coming from the adult entertainment industry, as this kind of thing literally destroys their entire business model. Who needs their adladen videos or their salacious ac…

> I wonder if a lot of this outrage isn't from the tech side (they tend to be fairly open about that stuff) but rather if it is coming from the adult entertainment industry, as this kind of thing literally destroys their entire business model.

Does it destroy the business model where you can see all the images for free on the internet, or the business model where you can pay money to converse with an hourly Filipina worker who will claim to be the same person who appears in the images?

Where does the adult entertainment industry get hurt?

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#103
If you want porn, there are Stable Diffusion models out there that will generate it. There's one model that seems to generate nudes by default; if you don't ask for clothes, you don't get them. Whatever.

This isn't important. What is important is that we can't prevent LLMs from doing things they're not supposed to. Which means connecting their output to anything important is a very bad idea for now.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#104
post #98
post #20

Earlier quoted context omitted.

The latter would be preferred by most, and is most aligned with individualism, but sadly that is not where we are as a society. There are an entire class of people who believe they know what is best for you, about nearly every subject matter, and wish to limit all aspects of technology, life, politics, etc, to suit their superior beliefs.

Alternatively, would you rather a world with 80% functionality safely, or a world with 100% functionality with people you don’t trust doing malicious things? One is clearly the least worst

> Alternatively, would you rather a world with 80% functionality safely

Obviously this is preferable because safety is uniform in its application to everyone and universally agreed upon.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#105

Together with fancy silicon chips, AI models and everything else that's being exported from the US , the world has to endure this puritanistic views export too.

American puritans are not the only group with a sensitivity toward nudity (and it’s rather small), it’s just the only one allowed to be a punching bag on Reddit.

The legal situation for generated nudity is better in the US than most other countries. You can't accidentally create illegal CSAM in the US.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#106

> Large language models are essentially supercharged versions of the autocomplete feature that smartphones have used for years in order to predict the rest of a word a person is typing. I'm not sure who this blog is targeted at, but this is fairly inaccurate and is way too dumbed-down to be useful.

Autocomplete models and LLMs do literally use the same model architecture, but since transformers are universal function approximators, they may not be representing the same function.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#107
post #98

Earlier quoted context omitted.

Alternatively, would you rather a world with 80% functionality safely, or a world with 100% functionality with people you don’t trust doing malicious things? One is clearly the least worst

Any image an AI can generate could just as easily be drawn or painted by one of the tens of millions of competent artists in the world.

However it can't be produced at the same scale and flood the Internet with misinformation or disturbing imagery at the same rate

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#108

For example blood is seen as sensitive but ketchup is not. But visually they look similar and the AI does not know.

Does it matter ? It is like duck typing , If it looks like blood to a human and to AI both it should be tagged NSFW ?

It is not about what it actually is, only what the human viewer will think it is, training a model on that shouldn’t be that hard , we are predictable creatures when it comes to this kind of thing

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#109

Earlier quoted context omitted.

> And prevent chat algorithms from expressing free thought. What do you mean free thought ? Since when does a data synthesis process create free thought? Is thought even free? Aren't we all constrained by taboo, social norms, the words we have to use, what we know and how, the list goes on...

I’ve always freely expressed my thoughts, but that’s just a personal anecdote from one data synthesis process to another. YMMV. : )

You must only have incredibly boring and orthodox and unoffensive thoughts..!

Or be independently wealthy, with your well-being entirely independent of the opinions of people with power over you.

The rest of us have to watch what we say.

Re: AI Art Generators Can Be Fooled into Making NSFW Images

#110

That's why my friends and I built the Align API ( https://alignapi.com ) to detect NSFW, Sensitive Prompts etc. It's such a widespread issue and can get you kicked out from the App Store/Play Store/Open AI API etc

This system seemingly would defeat your solution as well
Post reply on HN