Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

finance.yahoo.com

Post reply on HN
Print view View original

71–80 of 103 posts

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#71

Post by ben_w »

krapp wrote: post #69
nozzlegear wrote: post #53

Earlier quoted context omitted.

Meh, I don't buy it. People dislike AI generated images and art more than they dislike AI generated, well, anything. AI images adorning an article, blog post, announcement or product listing is the hallmark of a cheap, bottom of the barrel product these days, if not an outright scam.

Businesses don't care, it's more important to the bottom line to use AI than not. And they know that eventually people will just learn to accept it.

I am uncertain about this.

Yes, GenAI content is cheap.

But a business whose output is identical to everyone else's, because everyone is using the same models to solve the same problems, has no USP and no signal to customers to say why they're different.

The meme a while back about OpenAI having no moat? That's just as true for businesses depending on any public AI tool. If you can't find something that AI fails at, and also show this off to potential customers, then your business is just a lottery ticket with extra steps.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#73

Post by JKCalhoun »

chrisjj wrote: post #62
TheAlchemist wrote: post #60

What's amazing to me is that this is silenced by HN. It should be a major topic of discussion here.

What makes you say it is silenced by HN?

This seems like it should be on the HN front page.

And yesterday.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#75

Post by johneth »

wolvoleo wrote: post #42
akutlay wrote: post #2

It seems X's Grok became the first large LLM provider to weaken the content moderation rules. If people don't react enough, we will likely lose the first line of defense for keeping AI safe for anyone. Large providers need to act responsibly as the barrier of entry is practically 0.

True, CSAM should be blocked by all means. That's clear as day. However I think for Europe the regular sexual content moderation (even in text chat) is way over the top. I know the US is very prudish but here most people aren't. If you mention something erotic to a mainstream AI it will immediately close down which is super annoying because it blocks using it for such discussion topics. It feels a bit like foreign mo…

It's nonconsensual generation of sexual content of real people that is breaking the law. And things like CSAM generation which is obviously illegal.

> It feels a bit like foreign morals are being forced upon us.

Welcome to the rest of the world, where US morals have been forced upon us for decades. You should probably get used to it.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#76

Post by johneth »

thrance wrote: post #72

Grok breaks France's hate-speech laws all the time but they're only going after it because it can create images of naked people? Musk's propaganda nexus should have been banned years ago here, but not for this stupid reason.

It makes sexual images of real people without their consent. That's what's breaking the law.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#77

Post by chrisjj »

zajio1am wrote: post #46
nutjob2 wrote: post #31

Earlier quoted context omitted.

Safety isn't just implemented via system prompts, it's also a matter of training and fine tuning, so what you're saying is incorrect. If you think people here think that models should enable CSAM you're out of your mind. There is such thing as reasonable safety, it not all or nothing. You also don't understand the diversity of opinion here. More broadly, if you don't reasonable regulate your own models and related wo…

When these models are fine tuned to allow any kind of nudity, i would guess they also can be used to generate nude images of children. There is a level of generalization in these models. So it seems to me that arguing for restrictions that could be effectively implemented via prompt validation only is just indirect argumentation against open-weight models.

> When these models are fine tuned to allow any kind of nudity

If you're suggesting Grok is fine-tuned to allow any kind of nudity, some evidence would be in order.

The article suggests otherwise: "The service prohibits pornography involving real people’s likenesses and sexual content involving minors, which is illegal to create or distribute."

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#78

Post by chrisjj »

johneth wrote: post #76
thrance wrote: post #72

Grok breaks France's hate-speech laws all the time but they're only going after it because it can create images of naked people? Musk's propaganda nexus should have been banned years ago here, but not for this stupid reason.

It makes sexual images of real people without their consent. That's what's breaking the law.

Is an image of someone wearing only a bikini seriously claimed to be sexual here?

Not by this article, for sure.

"The service prohibits pornography involving real people’s likenesses and sexual content involving minors, which is illegal to create or distribute.

Still, users have prompted Grok to digitally remove clothing from photos — mostly of women — so the subjects appeared to be wearing only underwear or bikinis."

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#79

Post by krapp »

ben_w wrote: post #71
krapp wrote: post #69

Earlier quoted context omitted.

Businesses don't care, it's more important to the bottom line to use AI than not. And they know that eventually people will just learn to accept it.

I am uncertain about this. Yes, GenAI content is cheap. But a business whose output is identical to everyone else's, because everyone is using the same models to solve the same problems, has no USP and no signal to customers to say why they're different. The meme a while back about OpenAI having no moat? That's just as true for businesses depending on any public AI tool. If you can't find something that AI fails at,…

Most businesses don't compete on difference - most competitors are virtually indistinguishable from one another. Rather they tend to compete on brand identity and loyalty.

I think businesses assume the output of AI can be the same as with their current workflow, just with the benefit of cutting their workforce, so all upside and no downside.

I also suspect that a lot of businesses (at least the biggest ones) are looking into hosting their own LLM infrastructure rather than depending on third party services, but even if not there are plenty of "indispensible" services that businesses rely on already. Look at AWS.

Re: Grok Sexual Images Draw Rebuke, France Flags Content as Illegal

#80

Post by chrisjj »

ben_w wrote: post #68
chrisjj wrote: post #64

Earlier quoted context omitted.

> We don't want models that do this. But plenty enough people do want them. Grok is meeting demand.

"We the people" in agregate. "Many individuals" != democratic majority. To argue otherwise is to claim that the ~1% of the population who are into this are going to sway the governments or the people they represent.

If we're talking about undressing, there is no aggregate. Some people want something; others want them not to have it. Simple.

What the former want is not illegal. So the fact they are a minority is irrelevent. Minorites have rights too.

If we're talking about genuine CSAM, that very different and not even limited to undressing.

Post reply on HN