Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

Post reply on HN
Print view View original

31–40 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#31

Post by nutjob2 »

zajio1am wrote: post #14
akutlay wrote: post #2

It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

This is already possible, just download open-weight model and run it locally. It seems absurd to me to enforce content rules on AI services and even more that people on Hacker News advocate for that.

Safety isn't just implemented via system prompts, it's also a matter of training and fine tuning, so what you're saying is incorrect.

If you think people here think that models should enable CSAM you're out of your mind. There is such thing as reasonable safety, it not all or nothing. You also don't understand the diversity of opinion here.

More broadly, if you don't reasonable regulate your own models and related work, then it attracts government regulation.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#32

Post by lokar »

ls612 wrote: post #30
lokar wrote: post #20

Earlier quoted context omitted.

Photoshop is fine, running a business where you produce CSAM for people with photoshop is not. And this has been very clear for a while now. I did not see the details of what happened, but if someone did in fact take a photo of a real child they had no connection to and caused the images to be created, then yes, they should be investigated, and if the prosecutor thinks they can get a conviction they should be charged…

Somehow I doubt the prosecutor will apply the same standard to the other image generation models, which I bet (obviously without evidence given the nature of this discussion) can be convinced by a motivated adversary to do the same thing at least once. But alas, selective prosecution is the foundation of political power in the west and pointing that out gets you nothing but downvotes. patio11 once put it that pointin…

You often see (appropriately, IMO) a certain amount of discretion wrt prosecution when things are changing quickly.

I doubt anyone will go to jail over this. What (I think) should happen is state or federal law enforcement need to make it very clear to Xai (and the others) that this is unacceptable, and that if it keep happening, and you are not showing that you are fixing it (even if that means some degradation in the capability of the system/service), then you will be charged.

One of the strengths of the western legal system that I think is under appreciated by people here is that it is subject to interpretation. Law is not Code. This makes it flexible to deal with new situations, and this is (IME) always accompanied by at least a small amount of discretion in enforcement. And in the end, the laws and how they are interpreted and enforced are subject to democratic forces.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#33

Post by [deleted] »

dragonwriter wrote: post #27
chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

> “AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” > Not possible. Note that the description of the accusation earlier in the article is: > The French government accused Grok on Friday of generating “clearly illegal” sexual content on X without people’s consent, flagging the matter as potentially violating the European Union’s Digita…

[deleted]

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#34

Post by 7bit »

nozzlegear wrote: post #28
zajio1am wrote: post #14

Earlier quoted context omitted.

This is already possible, just download open-weight model and run it locally. It seems absurd to me to enforce content rules on AI services and even more that people on Hacker News advocate for that.

Why does that seem absurd to you?

Don't feed the troll

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#35

Post by pureagave »

BigTTYGothGF wrote: post #7
chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

Then maybe they shouldn't go to market.

AI is a nation defense issue. No nation has the luxury to stop their AI companies without the risk of losing national sovereignty.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#36

Post by pureagave »

ben_w wrote: post #24
krapp wrote: post #19

Earlier quoted context omitted.

>To which governments, courts, and populations likely respond "We don't care if you can't go to market. We don't want models that do this. Solve it or don't offer your services here." No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deep…

> No, they likely won't. AI has become far too big to fail at this point. So much money has been invested in it that speculation on AI alone is holding back a global economic collapse. Governments and companies have invested in AI so deeply that all failure modes have become existential. Not in Europe it hasn't, and definitely not for specifically image generation, where it seems to be filling the same role as clipar…

I'm sorry to tell you this, but the EU has already been lost.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#37

Post by belter »

pureagave wrote: post #35
BigTTYGothGF wrote: post #7

Earlier quoted context omitted.

Then maybe they shouldn't go to market.

AI is a nation defense issue. No nation has the luxury to stop their AI companies without the risk of losing national sovereignty.

So child porn is now a national security issue?

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#38

Post by belter »

belter wrote: post #17
chrisjj wrote: post #4

“AI products must be tested rigorously before they go to market to ensure they do not have the capability to generate this material,” Not possible.

Possible or not, what about starting by criminal investigation, to force disclosure, and find out if Musk company had child porn in the training data?

AI generates child porn, HN downvotes a proposal for an investigation...

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#39

Post by ls612 »

lokar wrote: post #32
ls612 wrote: post #30

Earlier quoted context omitted.

Somehow I doubt the prosecutor will apply the same standard to the other image generation models, which I bet (obviously without evidence given the nature of this discussion) can be convinced by a motivated adversary to do the same thing at least once. But alas, selective prosecution is the foundation of political power in the west and pointing that out gets you nothing but downvotes. patio11 once put it that pointin…

You often see (appropriately, IMO) a certain amount of discretion wrt prosecution when things are changing quickly. I doubt anyone will go to jail over this. What (I think) should happen is state or federal law enforcement need to make it very clear to Xai (and the others) that this is unacceptable, and that if it keep happening, and you are not showing that you are fixing it (even if that means some degradation in t…

When the GP said “not possible” they were referring to the strict letter of the law that I was, not to your lower standard of “make a good effort to fix it”. Law is not code because that gives the lawgivers discretion to exercise power arbitrarily while convincing the citizens that they live under the “rule of law”. At least the Chinese for all their faults don’t bother with the pretense.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#40

Post by squigz »

pureagave wrote: post #35
BigTTYGothGF wrote: post #7

Earlier quoted context omitted.

Then maybe they shouldn't go to market.

AI is a nation defense issue. No nation has the luxury to stop their AI companies without the risk of losing national sovereignty.

Lumping image gen models, LLMs, and other forms of recent machine learning altogether and dressing it up in the "National Defence" ribbon doesn't seem like a great idea.

I don't think the ability for citizens to make deep fake porn of whoever they want is the same as a country not investing in practical defensive applications of AI.

Post reply on HN