Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

1–10 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#2
It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#5
post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

It's extremely possible! As the source article notes, the Grok developers specifically chose to make their AI more permissive of sexual content than their competitors, which won't produce such images. This isn't a scenario where someone developed a complex jailbreak to circumvent Grok's built-in protections.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#6
post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

> Not possible.

To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here."

Also… I think they probably could solve this. AI image analysis is a thing. AI that estimate age from an image has been a thing for ages. It's not like the idea of throwing the entire internet worth of images at a training sessions just to make a single "allowed/forbidden" filter is even ridiculous compared to the scale of all the other things going on right now.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#9
post #6
post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

> Not possible. To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." Also… I think they probably could solve this. AI image analysis is a thing. AI that estimate age from an image has been a thing for ages. It's not like the idea of throwing the entire internet worth of images at a trainin…

These models generate probably a billion images a day. If getting it wrong for even one of those images is enough to get the entire model banned then it probably isn't possible and this de facto outlaws all image models. That may precisely be the point of this tbh.
Post reply on HN