Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

Post reply on HN
Print view View original

61–70 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#61

Post by sam_lowry_ »

wolvoleo wrote: post #42
akutlay wrote: post #2

It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

True, CSAM should be blocked by all means. That's clear as day. However I think for Europe the regular sexual content moderation (even in text chat) is way over the top. I know the US is very prudish but here most people aren't. If you mention something erotic to a mainstream AI it will immediately close down which is super annoying because it blocks using it for such discussion topics. It feels a bit like foreign mo…

Funnily Mistral is as much censored as ChatGPT.

One should search Huggingface for role-playing models to have a decent level of erotic content, but even that does not guarantee you a pleasant experience.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#63

Post by chrisjj »

wolvoleo wrote: post #42
akutlay wrote: post #2

It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

True, CSAM should be blocked by all means. That's clear as day. However I think for Europe the regular sexual content moderation (even in text chat) is way over the top. I know the US is very prudish but here most people aren't. If you mention something erotic to a mainstream AI it will immediately close down which is super annoying because it blocks using it for such discussion topics. It feels a bit like foreign mo…

Some misunderstanding here. This article makes abolutely no mention of CSAM. The objection is to "sexual content on X without people’s consent".

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#64

Post by chrisjj »

krapp wrote: post #19
ben_w wrote: post #6

Earlier quoted context omitted.

> Not possible. To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." Also… I think they probably could solve this. AI image analysis is a thing. AI that estimate age from an image has been a thing for ages. It's not like the idea of throwing the entire internet worth of images at a trainin…

>To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deep…

> We don't want models that do this.

But plenty enough people do want them. Grok is meeting demand.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#65

Post by [deleted] »

lokar wrote: post #12
ls612 wrote: post #9

Earlier quoted context omitted.

These models generate probably a billion images a day. If getting it wrong for even one of those images is enough to get the entire model banned then it probably isn't possible and this de facto outlaws all image models. That may precisely be the point of this tbh.

If they can't prevent child porn, then it should be banned.

[deleted]

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#66

Post by chrisjj »

dragonwriter wrote: post #27
chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

> “AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” > Not possible. Note that the description of the accusation earlier in the article is: > The French government accused Grok on Friday of generating “clearly illegal” sexual content on X without people’s consent, flagging the matter as potentially violating the European Union’s Digita…

> it is quite practical for the Grok product to enforce consent of the user whose content is being operated on

No, because it cannot even ID that user.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#67

Post by chrisjj »

wolvoleo wrote: post #47
chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

I'm sure it's possible. If anything they can just run an AI check after generation. Similar to the way Google makes sure it doesn't return CSAM in their results. If they can filter that, the AI providers can check their own output too.

I think you've mistaken CSAM for child pornography.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#68

Post by ben_w »

chrisjj wrote: post #64
krapp wrote: post #19

Earlier quoted context omitted.

>To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deep…

> We don't want models that do this. But plenty enough people do want them. Grok is meeting demand.

"We the people" in agregate.

"Many individuals" != democratic majority.

To argue otherwise is to claim that the ~1% of the population who are into this are going to sway the governments or the people they represent.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#69

Post by krapp »

nozzlegear wrote: post #53
krapp wrote: post #41

Earlier quoted context omitted.

Every industry that uses images and art in any way - entertainment, publishing, science, advertising, you name it - is already investing in image and video generation. If any business in these fields isn't already exclusively using LLMs to generate their content, I promise you they're working on it as aggressively as they can afford to. Grok is a novelty, but that's Grok.

Meh, I don't buy it. People dislike AI generated images and art more than they dislike AI generated, well, anything. AI images adorning an article, blog post, announcement or product listing is the hallmark of a cheap, bottom of the barrel product these days, if not an outright scam.

Businesses don't care, it's more important to the bottom line to use AI than not.

And they know that eventually people will just learn to accept it.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#70

Post by ben_w »

zajio1am wrote: post #51
lokar wrote: post #20

Earlier quoted context omitted.

Photoshop is fine, running a business where you produce CSAM for people with photoshop is not. And this has been very clear for a while now. I did not see the details of what happened, but if someone did in fact take a photo of a real child they had no connection to and caused the images to be created, then yes, they should be investigated, and if the prosecutor thinks they can get a conviction they should be charged…

> Photoshop is fine, running a business where you produce CSAM for people with photoshop is not. And this has been very clear for a while now. What if Photoshop is provided as a web service? This is analogous to running image generation as a service. In both cases provider takes input from the user (in one case textual description, on the other case sequence of mouse events) and generates and image with an automated…

If you really care, ask a lawyer, not a tech forum.

I anticipate there will already be case law/prescident showing the shape of what is allowed/forbidden, and most of us won't know the legal jargon necessary to understand the answer.

Or answers, plural, because laws vary by jurisdiction.

Most of us here are likely to be worse at painting such boundaries than an LLM. LLMs can pass at least one of the bar exams, most of us probably cannot.

Post reply on HN