Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

X offices raided in France as UK opens fresh investigation into Grok

bbc.com

Post reply on HN
Print view View original

591–600 of 1001 posts

Re: X offices raided in France as UK opens fresh investigation into Grok

#591

Post by KaiserPro »

muyuu wrote: post #535
madeofpalk wrote: post #522

Earlier quoted context omitted.

Let’s take a step back and remove AI generation from the conversation for a moment. Did X do enough to prevent its website being used to distribute illegal content - consensual sexual material of both adults and children? Now reintroduce AI generation, where X plays a more active role in facilitating the creation of that illegal content.

[flagged]

The law is concrete on this.

In the UK, you must take "reasonable" steps to remove illegal content.

This normally means some basic detection (ie fingerprinting which is widely used from a collaborative database) or if a user is consistently uploading said stuff, banning them.

Allowing a service that you run to continue to generate said illegal content, even after you publicly admit that you know its wrong, is not reasonable.

Re: X offices raided in France as UK opens fresh investigation into Grok

#592

Post by muyuu »

KaiserPro wrote: post #591
muyuu wrote: post #535

Earlier quoted context omitted.

[flagged]

The law is concrete on this. In the UK, you must take "reasonable" steps to remove illegal content. This normally means some basic detection (ie fingerprinting which is widely used from a collaborative database) or if a user is consistently uploading said stuff, banning them. Allowing a service that you run to continue to generate said illegal content, even after you publicly admit that you know its wrong, is not rea…

that doesn't sound concrete to me, at all

Re: X offices raided in France as UK opens fresh investigation into Grok

#593

Post by cubefox »

scott_w wrote: post #484
cubefox wrote: post #474

Earlier quoted context omitted.

First of all, the Guardian is known to be heavily biased again Musk. They always try hard to make everything about him sound as negative as possible. Second, last time I tried, Grok even refused to create pictures of naked adults. I just tried again and this is still the case: https://x.com/i/grok/share/1cd2a181583f473f811c0d58996232ab The claim that they released a tool with "seemingly no guardrailes" is therefore c…

For more evidence: https://www.bbc.co.uk/news/articles/cvg1mzlryxeo Also, X seem to disagree with you and admit that CSAM was being generated: https://arstechnica.com/tech-policy/2026/01/x-blames-users-f... Also the reason you can’t make it generate those images is because they implemented safeguards since that article was written: https://www.ofcom.org.uk/online-safety/illegal-and-harmful-c... This is because of gov…

> Also, X seem to disagree with you and admit that CSAM was being generated

That post doesn't contain such an admission, it instead talks about forbidden prompting.

> Also the reason you can’t make it generate those images is because they implemented safeguards since that article was written:

That article links to this article: https://x.com/Safety/status/2011573102485127562 - which contradicts your claim that there were no guardrails before. And as I said, I already tried it a while ago, and Grok also refused to create images of naked adults then.

Re: X offices raided in France as UK opens fresh investigation into Grok

#594

Post by KaiserPro »

popalchemist wrote: post #483
miki123211 wrote: post #454

This vindicates the pro-AI censorship crowd I guess. It definitely makes it clear what is expected of AI companies. Your users aren't responsible for what they use your model for, you are, so you'd better make sure your model can't ever be used for anything nefarious. If you can't do that without keeping the model closed and verifying everyone's identities... well, that's good for your profits I guess.

It's a bit of a leap to say that the model must be censored. SD and all the open image gen models are capable of all kinds of things, but nobody has gone after the open model trainers. They have gone after the companies making profits from providing services.

Again its all about reasonable.

Firstly does the open model explicitly/tacitly allow CSAM generation?

Secondly, when the trainers are made aware of the problem, do they ignore it or attempt to put in place protections?

Thirdly, do they pull in data that is likely to allow that kind of content to be generated?

Fourthly, when they are told that this is happening, do they pull the model?

Fithly, do they charge for access/host the service and allow users to generate said content on their own servers?

Re: X offices raided in France as UK opens fresh investigation into Grok

#597

Post by mnewme »

PeterStuer wrote: post #526
mnewme wrote: post #523

Earlier quoted context omitted.

That is not the same. Correct comparison would be: You provide a photo studio with an adjacent art gallery and allow people to shoot CSAM content there and then exhibit their work.

Not knowing any better, and not having seen any of the alleged images, my default guess would be they used the exact same CSAM filtering pipeline already in place on X regardless of the origin of the submitted images.

They obviously didn’t really implement anything as you can find that content or involuntary nudes of other people, which is also an invasion of privacy, super easily

Re: X offices raided in France as UK opens fresh investigation into Grok

#598

Post by joe_mamba »

KaiserPro wrote: post #576
joe_mamba wrote: post #540

Earlier quoted context omitted.

How? THat's like the 1993 moral panic that video games like Doom cause mass shootings, or the 1980's mass panic that metal music causes satanist, or the 1950s moral panic that superhero comic book violence leads to juvenile delinquency. Politicians are constantly looking for an external made up enemy to divert attention to from the real problems. People like Epstein and mass woman/child exploitation have existed for…

> THat's like the 1993 moral panic that video games like Doom cause mass shootings, Apart from doom wasn't producing illegal content. the point is that grok is generating illegal content for those jurisdictions. In france you can't generate CSAM, in the UK you can't distribute CSAM. Those are actual laws with legal tests, none of them need to be of actual people, they just need to depict _children_ to be illegal. Mor…

>Apart from doom wasn't producing illegal content.

Sure but where's the proof that Grok is actually producing illegal content? I searched for news sources, but they're just all parroting empty accusations not concrete documented cases.

Re: X offices raided in France as UK opens fresh investigation into Grok

#599

Post by mnewme »

exodust wrote: post #531
mnewme wrote: post #519

Good one. No platform ever should allow CSAM content. And the fact that they didn’t even care and haven’t want to spend money for implementing guardrails or moderation is deeply concerning. This has imho nothing to do with model censorship, but everything with allowing that kind of content on a platform

[flagged]

What the hell?

As a father there shouldn’t be any CSAM content anywhere.

And think about that it is already proven these models apparently had CSAM content in their training data.

Also what about the nudes of actual people? That is invasion of privacy

I am shocked that we are even discussing this.

Re: X offices raided in France as UK opens fresh investigation into Grok

#600

Post by didntcheck »

PaulRobinson wrote: post #589
muyuu wrote: post #532

Earlier quoted context omitted.

Frankly it sounds to me like a "show me the man and I'll show you the crime" kind of operation. France and the UK, and judging by yesterday's speech by the PM of Spain maybe the whole EU might be looking to do what China and Russia did earlier on and start cracking down on foreign social media by making it impossible to operate without total alignment with their vision and not just their (new) rules. Together with a…

It's worth pointing out that in France and the UK, the authorities involved are arms length independent of the political bodies - it's not like the US where if you give the President good vibes you can become head of the FBI, and all you have to do in return is whatever he says. There are statutory instruments (in France, constitutional clauses), that determine the independence of these authorities. They are tasked -…

> It's worth pointing out that in France and the UK, the authorities involved are arms length independent of the political bodies

As someone who has lived in (and followed current affairs) in both of these countries, this is a very idealistic and naïve view. There can be a big gap between theory and practice

> There are statutory instruments (in France, constitutional clauses), that determine the independence of these authorities.

> They are tasked - and held to account by respective legislative bodies -

It's worth nothing here that the UK doesn't have separation of powers or a supreme court (in the US sense)

Post reply on HN