Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Teen boys use AI to make fake nudes of classmates, sparking police probe

arstechnica.com

Post reply on HN
Print view View original

41–50 of 90 posts

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#41

Post by Wowfunhappy »

nextaccountic wrote: post #12
meheleventyone wrote: post #5

Earlier quoted context omitted.

That’s not comparable though since the deepfake is going to be photo-realistic and the image wasn’t just made but shared. As noted in the article it seems that making these sorts of images of real people is highly likely to be made illegal in its own right and the behaviour could be illegal already under different laws.

> That’s not comparable though since the deepfake is going to be photo-realistic and the image wasn’t just made but shared You can make a photorealistic drawing too, that can pass as a real photography (and with enough skill it will be better than whatever generative models can produce). The difference here is the lower barrier to make the images. But I think that even a photorealistic drawing, if made and distribute…

> But I think that even a photorealistic drawing, if made and distributed to others, should be considered a form of harassment.

I agree, but critically, I think it's the harassment that matters, not the drawing.

If someone draws something in the privacy of their own home (maybe or maybe not with the assistance of an AI), and the police find it in an unrelated search, they should have nothing to prosecute. Drawing is one way humans work through their thoughts and emotions; the act of putting pencil to paper—including digital pencil to digital paper—should never be illegal, lest we effectively create thought crime.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#42

Post by [deleted] »

ngngngng wrote: post #32
seasox wrote: post #24

Earlier quoted context omitted.

> they draw a naked picture of a classmate and share it, should that be illegal too? I don‘t see the argument here. What you describe is sexual harassment and should be illegal.

I guess I've never looked into everything that can constitute sexual harrassment. If person A draws a naked picture and shares it with person B, and it looks like person C, then person C has been sexually harassed?

[deleted]

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#43

Post by shrimp_emoji »

vivekd wrote: post #7
Invictus0 wrote: post #2

Should it be illegal for a kid to draw a "naked picture" of another kid?

In Canada it is illegal to make naked pictures of kids even with ai. Not sure about US

They also don't care about freedom of speech there (or anywhere) as much as they do in the US.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#44

Post by irrational »

nextaccountic wrote: post #12
meheleventyone wrote: post #5

Earlier quoted context omitted.

That’s not comparable though since the deepfake is going to be photo-realistic and the image wasn’t just made but shared. As noted in the article it seems that making these sorts of images of real people is highly likely to be made illegal in its own right and the behaviour could be illegal already under different laws.

> That’s not comparable though since the deepfake is going to be photo-realistic and the image wasn’t just made but shared You can make a photorealistic drawing too, that can pass as a real photography (and with enough skill it will be better than whatever generative models can produce). The difference here is the lower barrier to make the images. But I think that even a photorealistic drawing, if made and distribute…

Yes, when I was in college I took an art class where we had to cut a magazine picture in half, glue it to a piece of paper, then draw the other half. Mine was good enough that unless you got up close, you couldn’t tell which was the photo and which was my drawing. If someone had taken a picture of it, you wouldn’t have been able to tell at all. Photorealistic drawings are very possible.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#45

Post by autoexec »

kibibu wrote: post #28
autoexec wrote: post #6

If they'd cut out their classmate's head from their yearbook photo and pasted it onto the body of a pornstar with elmer's glue would police have gotten involved? This type of bullying is as old as dirt. Bullies suck, and the kids who did this should get in some kind of trouble with the school and their parents, but this is not something police need to be involved in. The moral panic over deepfakes is ridiculous, but…

You don't see a tangible difference in the detectability of the fake being a factor? The glued on photo will always be uncanny, but deepfake will not.

A deepfake is more detectable as a fake than a good photoshop, and people have been using that for this sort of thing for decades, but ultimately it doesn't really matter. The fact is that giving children police records doesn't improve the situation in any way. These kids need education and parenting, not jail time, court dates, and a sex offender status.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#46

Post by rightbyte »

hhh wrote: post #35
JumpCrisscross wrote: post #31

Earlier quoted context omitted.

> glued on photo will always be uncanny, but deepfake will not Eh, this is still a civil matter. Unless the picture was made for the purpose of harassment, there is no ill will we can presuppose the perpetrators had towards the victim. Just immense immaturity and a lack of judgement and empathy. Judgement and empathy can be taught. (If it was done with the intent of causing distress, i.e. cruelly, it's a matter for t…

Did you read the article? It states they created the images and were sharing them. This 'boys will be boys' mentality contributes to these things.

Fair enough. But this is like 1/100th of the transgression of spreading actual photos from gym class showers, which is a thing that happens quite a lot since everyone has a camera nowadays.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#47

Post by dragonwriter »

ngngngng wrote: post #13
meheleventyone wrote: post #5

Earlier quoted context omitted.

That’s not comparable though since the deepfake is going to be photo-realistic and the image wasn’t just made but shared. As noted in the article it seems that making these sorts of images of real people is highly likely to be made illegal in its own right and the behaviour could be illegal already under different laws.

So if a teenager is skilled enough at drawing on their iPad to make something look photorealistic, and they draw a naked picture of a classmate and share it, should that be illegal too? I'm not trying to say it's ok, but just like the person you replied to, I truly find these things comparable.

> So if a teenager is skilled enough at drawing on their iPad to make something look photorealistic, and they draw a naked picture of a classmate and share it, should that be illegal too?

If the person is recognizable, then in many cases it would violate existing nonconsensual/revenge porn laws, which very often are not concerned with provenance but whether its a explicit, a recognizable depiction, and nonconsensual.

(Depending on where it is shared it might, as others note, be sexual harassment as well.)

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#48

Post by JumpCrisscross »

rightbyte wrote: post #46
hhh wrote: post #35

Earlier quoted context omitted.

Did you read the article? It states they created the images and were sharing them. This 'boys will be boys' mentality contributes to these things.

Fair enough. But this is like 1/100th of the transgression of spreading actual photos from gym class showers, which is a thing that happens quite a lot since everyone has a camera nowadays.

> spreading actual photos from gym class showers, which is a thing that happens quite a lot

Source? It's a shower. Where are you hiding the phone?

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#49

Post by JumpCrisscross »

nvy wrote: post #10

Eventually, society is going to have to come around to the fact that this technology can't be legislated away. It's here to stay and it's only going to improve. I hope we get to a place where the automatic assumption upon seeing any digital image is that it's probably fake.

> society is going to have to come around to the fact that this technology can't be legislated away

Neither can fraud or murder. Yet we still ban it. This concept that if a problem cannot be 100% solved by the law, it shouldn't be banned, is an umbrella for the insufferable.

Re: Teen boys use AI to make fake nudes of classmates, sparking police probe

#50

Post by hfuyf65 »

tantalor wrote: post #40
JumpCrisscross wrote: post #31

Earlier quoted context omitted.

> glued on photo will always be uncanny, but deepfake will not Eh, this is still a civil matter. Unless the picture was made for the purpose of harassment, there is no ill will we can presuppose the perpetrators had towards the victim. Just immense immaturity and a lack of judgement and empathy. Judgement and empathy can be taught. (If it was done with the intent of causing distress, i.e. cruelly, it's a matter for t…

I think we can assume ill intent, the same as if they were spreading lies or real nudes (revenge porn).

Huh? Bunch of horny teens sharing fake pictures of nudes. Forgive me, but assuming ill intent is what is dangerous here.
Post reply on HN