Live data from Hacker News

Under new law, cops bust famous cartoonist for AI-generated CSAM

arstechnica.com

11–20 of 87 posts

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#11
Be interesting to see how this pans out in terms of the 1st amendment. Without a victim, it would be interesting to see how the courts rule. They could say its inherently unconstitutional but for sake of the general public, it is fine. This would be similar to the supreme court ruling on DUI checkpoints.

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#12
In British Columbia both text-based accounts (real and fictional, such as stories) and drawings of underage sexual activity are illegal (basically any sort of depiction, even if it just comes out of your mouth.)

So California is just starting to catch up.

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#13

In British Columbia both text-based accounts (real and fictional, such as stories) and drawings of underage sexual activity are illegal (basically any sort of depiction, even if it just comes out of your mouth.) So California is just starting to catch up.

Wrong country (at least for now...!)

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#14
post #11

Be interesting to see how this pans out in terms of the 1st amendment. Without a victim, it would be interesting to see how the courts rule. They could say its inherently unconstitutional but for sake of the general public, it is fine. This would be similar to the supreme court ruling on DUI checkpoints.

https://en.wikipedia.org/wiki/Legal_status_of_fictional_porn... comments a little on this and suggests that some of the existing laws have been tested in court already.

Still, it's probably better not to be involve in a case like United States vs. $YOU and then have your name appear in this Wikipedia article.

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#15
post #11

Be interesting to see how this pans out in terms of the 1st amendment. Without a victim, it would be interesting to see how the courts rule. They could say its inherently unconstitutional but for sake of the general public, it is fine. This would be similar to the supreme court ruling on DUI checkpoints.

I think the victim is "the state". The law seems to say that by creating a model using CSAM, certain outputs are CSAM, and the law can say whatever it wants to some extent; you just have to convince the Supreme Court that you're right.

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#16
post #6

Earlier quoted context omitted.

It sounds like we should be asking "why is it okay that the people training the models have CSAM?" It's not like it's legal to have, let alone distribute in your for-profit tool.

Read the sentence again. It doesn't claim the data set has CSAM but that it depicts victims. It also assumes that you need AI to see an example to draw it on demand which isn't true.

Yeah. I don’t like it, but I can see this getting overturned.

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#17
post #8
post #7

Earlier quoted context omitted.

There's a legally challengable assertion there; "trained on CSAM images". I imagine an AI image generation model could be readily trained on images of adult soldiers at war and images of children from instagram and then be used to generate imagery of children at war. I have zero interest in defending exploitation of children, the assertion that children had to have been exploited in order to create images of children…

It is known that the LAION dataset underpinning foundation models like Stable Diffusion contained at least a few thousand instances of real-life CSAM at one point. I think you would be hard-pressed to prove that any model trained on internet scrapes definitively wasn't trained on any CSAM whatsoever. https://www.theverge.com/2023/12/20/24009418/generative-ai-i...

Then all image generation models should be considered inherently harmful, no?

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#18

In British Columbia both text-based accounts (real and fictional, such as stories) and drawings of underage sexual activity are illegal (basically any sort of depiction, even if it just comes out of your mouth.) So California is just starting to catch up.

Wrong country (at least for now...!)

Not wrong country. In 2021, a Texas man was sentenced to 40 years in federal prison over CSAM text and drawings - https://www.justice.gov/opa/pr/texas-man-sentenced-40-years-...

Re: Under new law, cops bust famous cartoonist for AI-generated CSAM

#20
post #2

> "The creation of CSAM using AI is inherently harmful to children because the machine-learning models utilized by AI have been trained on datasets containing thousands of depictions of known CSAM victims," it says, "revictimizing these real children by using their likeness to generate AI CSAM images into perpetuity." The word "inherently" there seems like a big stretch to me. I see how it could be harmful to them, b…

It sounds like we should be asking "why is it okay that the people training the models have CSAM?" It's not like it's legal to have, let alone distribute in your for-profit tool.

If you crawl any sufficiently large public collection of images you are bound to download some CSAM images by accident.

Filtering out any images of beaten up naked 7 year olds is certainly something you should do. But if you go by the US legal definition of "any visual depiction of sexually explicit conduct involving a minor (someone under 18 years of age)" you are going to have a really hard time filtering all of that automatically. People don't suddenly look differently when they turn 18, and "sexually explicit" is a wide net open to interpretation.

Post reply on HN