Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

Post reply on HN
Print view View original

41–50 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#41

Post by krapp »

nozzlegear wrote: post #26
krapp wrote: post #19

Earlier quoted context omitted.

>To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deep…

> AI has become far too big to fail at this point. This might be true for the glorified search engine type of AI that everyone is familiar with, but not for image generation. It's a novelty at best, something people try a couple times and then forget about.

Every industry that uses images and art in any way - entertainment, publishing, science, advertising, you name it - is already investing in image and video generation. If any business in these fields isn't already exclusively using LLMs to generate their content, I promise you they're working on it as aggressively as they can afford to.

Grok is a novelty, but that's Grok.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#42

Post by wolvoleo »

akutlay wrote: post #2

It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

True, CSAM should be blocked by all means. That's clear as day.

However I think for Europe the regular sexual content moderation (even in text chat) is way over the top. I know the US is very prudish but here most people aren't.

If you mention something erotic to a mainstream AI it will immediately close down which is super annoying because it blocks using it for such discussion topics. It feels a bit like foreign morals are being forced upon us.

Limits on topics that aren't illegal should be selectable by the user. Not baked in hard to the most restricted standards. Similar to the way I can switch off safe search in Google.

However CSAM generation should obviously be blocked and it's very illegal here too.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#44

Post by xenospn »

chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

If it's possible to create a model that generates photorealistic images based on a single line of text, it is 100% possible to restrict the output.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#45

Post by wolvoleo »

pureagave wrote: post #36
ben_w wrote: post #24

Earlier quoted context omitted.

> No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deeply that all failure modes have become existential. Not in Europe it hasn't, and definitely not for specifically image generation, where it seems to be filling the same role as clipar…

I'm sorry to tell you this, but the EU has already been lost.

Because we're not on the forefront of AI development? It also means we have less to lose when the bubble blows. I'm quite happy with the policies here. And we will become more independent from US tech. It'll just take time.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#46

Post by zajio1am »

nutjob2 wrote: post #31
zajio1am wrote: post #14

Earlier quoted context omitted.

This is already possible, just download open-weight model and run it locally. It seems absurd to me to enforce content rules on AI services and even more that people on Hacker News advocate for that.

Safety isn't just implemented via system prompts, it's also a matter of training and fine tuning, so what you're saying is incorrect. If you think people here think that models should enable CSAM you're out of your mind. There is such thing as reasonable safety, it not all or nothing. You also don't understand the diversity of opinion here. More broadly, if you don't reasonable regulate your own models and related wo…

When these models are fine tuned to allow any kind of nudity, i would guess they also can be used to generate nude images of children. There is a level of generalization in these models. So it seems to me that arguing for restrictions that could be effectively implemented via prompt validation only is just indirect argumentation against open-weight models.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#47

Post by wolvoleo »

chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

I'm sure it's possible. If anything they can just run an AI check after generation. Similar to the way Google makes sure it doesn't return CSAM in their results. If they can filter that, the AI providers can check their own output too.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#48

Post by lokar »

ls612 wrote: post #39
lokar wrote: post #32

Earlier quoted context omitted.

You often see (appropriately, IMO) a certain amount of discretion wrt prosecution when things are changing quickly. I doubt anyone will go to jail over this. What (I think) should happen is state or federal law enforcement need to make it very clear to Xai (and the others) that this is unacceptable, and that if it keep happening, and you are not showing that you are fixing it (even if that means some degradation in t…

When the GP said “not possible” they were referring to the strict letter of the law that I was, not to your lower standard of “make a good effort to fix it”. Law is not code because that gives the lawgivers discretion to exercise power arbitrarily while convincing the citizens that they live under the “rule of law”. At least the Chinese for all their faults don’t bother with the pretense.

If you reject the foundation of liberal western civilization I don’t know what to tell you.

Move to china?

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#49

Post by ls612 »

lokar wrote: post #48
ls612 wrote: post #39

Earlier quoted context omitted.

When the GP said “not possible” they were referring to the strict letter of the law that I was, not to your lower standard of “make a good effort to fix it”. Law is not code because that gives the lawgivers discretion to exercise power arbitrarily while convincing the citizens that they live under the “rule of law”. At least the Chinese for all their faults don’t bother with the pretense.

If you reject the foundation of liberal western civilization I don’t know what to tell you. Move to china?

I’m just pointing out how the world works in real life not saying that it is desirable. Thinking in terms of that distinction is very useful.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#50

Post by fatata123 »

pureagave wrote: post #36
ben_w wrote: post #24

Earlier quoted context omitted.

> No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deeply that all failure modes have become existential. Not in Europe it hasn't, and definitely not for specifically image generation, where it seems to be filling the same role as clipar…

I'm sorry to tell you this, but the EU has already been lost.

[dead]
Post reply on HN