Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

Post reply on HN
Print view View original

51–60 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#51

Post by zajio1am »

lokar wrote: post #20
ls612 wrote: post #18

Earlier quoted context omitted.

Should photoshop be outlawed? What about MS Paint? Both of them I’m pretty sure are capable of creating this stuff. Also, lets test your commitment to consistency on this matter. In most jurisdictions possession and creation of CSAM is a strict liability crime, so do you support prosecuting whatever journalist demonstrated this capability to the maximum extent of the law? Or are you only in favor of protecting childr…

Photoshop is fine, running a business where you produce CSAM for people with photoshop is not. And this has been very clear for a while now. I did not see the details of what happened, but if someone did in fact take a photo of a real child they had no connection to and caused the images to be created, then yes, they should be investigated, and if the prosecutor thinks they can get a conviction they should be charged…

> Photoshop is fine, running a business where you produce CSAM for people with photoshop is not. And this has been very clear for a while now.

What if Photoshop is provided as a web service? This is analogous to running image generation as a service. In both cases provider takes input from the user (in one case textual description, on the other case sequence of mouse events) and generates and image with an automated process, without specific human intentional input from the provider.

Note that in this case using them for producing CSAM was against terms of service, so the business was tricked to produce CSAM.

And there are other automated services that could be used for CSAM generation, for example automated photo booths. Should their operator be held liable if someone use them to produce CSAM?

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#52

Post by dragonwriter »

pureagave wrote: post #35
BigTTYGothGF wrote: post #7

Earlier quoted context omitted.

Then maybe they shouldn't go to market.

AI is a nation defense issue. No nation has the luxury to stop their AI companies without the risk of losing national sovereignty.

> AI is a nation defense issue.

AI image editors attached to social media networks with a design that allows producing AI edits (including, but not limited to, nonconsensual intimate images and child pornography) of other user’s media without consent are not a national defense issue, and, even to the extent that AI arguably is a national defense issue, those particular applications can be curtailed entirely by a nation without any adverse impact on national defense.

You can distort any issue by zooming out to orbital level and ignoring the salient details.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#53

Post by nozzlegear »

krapp wrote: post #41
nozzlegear wrote: post #26

Earlier quoted context omitted.

> AI has become far too big to fail at this point. This might be true for the glorified search engine type of AI that everyone is familiar with, but not for image generation. It's a novelty at best, something people try a couple times and then forget about.

Every industry that uses images and art in any way - entertainment, publishing, science, advertising, you name it - is already investing in image and video generation. If any business in these fields isn't already exclusively using LLMs to generate their content, I promise you they're working on it as aggressively as they can afford to. Grok is a novelty, but that's Grok.

Meh, I don't buy it. People dislike AI generated images and art more than they dislike AI generated, well, anything. AI images adorning an article, blog post, announcement or product listing is the hallmark of a cheap, bottom of the barrel product these days, if not an outright scam.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#54

Post by Ancapistani »

nutjob2 wrote: post #31
zajio1am wrote: post #14

Earlier quoted context omitted.

This is already possible, just download open-weight model and run it locally. It seems absurd to me to enforce content rules on AI services and even more that people on Hacker News advocate for that.

Safety isn't just implemented via system prompts, it's also a matter of training and fine tuning, so what you're saying is incorrect. If you think people here think that models should enable CSAM you're out of your mind. There is such thing as reasonable safety, it not all or nothing. You also don't understand the diversity of opinion here. More broadly, if you don't reasonable regulate your own models and related wo…

I’ve run into “safeguards” far more frequently than I’ve actually tried to go outside the bounds of the acceptable use policy. For example, when I was attempting to use ChatGPT to translate a journal that was handwritten in Russian that contained descriptions of violent acts. I wasn’t generating violent content, much less advocating it - I was trying to understand something someone who had already committed a violent act had written.

> If you think people here think that models should enable CSAM you're out of your mind.

Intentional creation of “virtual” CSAM should be prosecuted aggressively. Note that that’s not the same thing as “models capable of producing CSAM”. I very much draw the line in terms of intent and/or result, not capability.

> There is such thing as reasonable safety, it not all or nothing. You also don't understand the diversity of opinion here.

I agree, but believe we are quite far away from “reasonable safety”, and far away from “reasonable safeguards”. I can get GPT-5 to try to talk me into committing suicide more easily than I can get it to translate objectionable text written in a language I don’t know.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#55

Post by UncleMeat »

pureagave wrote: post #35
BigTTYGothGF wrote: post #7

Earlier quoted context omitted.

Then maybe they shouldn't go to market.

AI is a nation defense issue. No nation has the luxury to stop their AI companies without the risk of losing national sovereignty.

"We have to make the revenge porn machine for national defense" is the sort of thing that makes people light bay area tech busses on fire.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#56

Post by maplethorpe »

chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

Sure it is. Forbid training models on images of humans, humanoids, or living creatures, and they won't be able to generate images of those things. It's not like AI is some uncontrollable magic force that hatched out of an egg. It can only output what you put in.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#57

Post by SpicyLemonZest »

nozzlegear wrote: post #53
krapp wrote: post #41

Earlier quoted context omitted.

Every industry that uses images and art in any way - entertainment, publishing, science, advertising, you name it - is already investing in image and video generation. If any business in these fields isn't already exclusively using LLMs to generate their content, I promise you they're working on it as aggressively as they can afford to. Grok is a novelty, but that's Grok.

Meh, I don't buy it. People dislike AI generated images and art more than they dislike AI generated, well, anything. AI images adorning an article, blog post, announcement or product listing is the hallmark of a cheap, bottom of the barrel product these days, if not an outright scam.

People dislike AI generated art in the same way that they dislike cheap injection molded plastic. When they inspect it in detail, they wish it were something more expensive and artisan, but most of the time they barely notice it and just see that the world is a bit more colorful than a blank page or unfinished metal panel would be.

For context, the top 5 HN links as of this comment contain one attributed (https://xeiaso.net/notes/2026/year-linux-desktop/, characters page discloses Stable Diffusion usage) and one likely (https://www.madebywindmill.com/tempi/blog/hbfs-bpm/, high-context unattributed image with no Tineye results) AI generated image.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#58

Post by xena »

SpicyLemonZest wrote: post #57
nozzlegear wrote: post #53

Earlier quoted context omitted.

Meh, I don't buy it. People dislike AI generated images and art more than they dislike AI generated, well, anything. AI images adorning an article, blog post, announcement or product listing is the hallmark of a cheap, bottom of the barrel product these days, if not an outright scam.

People dislike AI generated art in the same way that they dislike cheap injection molded plastic. When they inspect it in detail, they wish it were something more expensive and artisan, but most of the time they barely notice it and just see that the world is a bit more colorful than a blank page or unfinished metal panel would be. For context, the top 5 HN links as of this comment contain one attributed ( https://xe…

Fwiw, replacing that is in my TODO list, but my TODO list is long.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#59

Post by SpicyLemonZest »

xena wrote: post #58
SpicyLemonZest wrote: post #57

Earlier quoted context omitted.

People dislike AI generated art in the same way that they dislike cheap injection molded plastic. When they inspect it in detail, they wish it were something more expensive and artisan, but most of the time they barely notice it and just see that the world is a bit more colorful than a blank page or unfinished metal panel would be. For context, the top 5 HN links as of this comment contain one attributed ( https://xe…

Fwiw, replacing that is in my TODO list, but my TODO list is long.

Entirely reasonable if you ask me!
Post reply on HN