Live data from Hacker News

Deepfakes Tore a High School Apart

404media.co

41–50 of 146 posts

Re: Deepfakes Tore a High School Apart

#41
post #9
post #2

Didn't get past the paywall but, recently a friend had their primary school targeted by blackmailers who took public photos of children and made (I'm told) extremely explicit images with them, threatening to release them if not paid. What's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel. Don't post innocuous…

> What's the defense? Prosecution of AI operators for making indecent images of children?

Although I agree this is necessary, I don't think it is sufficient.

Hackers and blackmailers on the internet can be anywhere from trivial to impossible to identify.

Even harder to prosecute when they're in a different jurisdiction, as not everywhere has extradition treaties to everywhere else. I wouldn't be overly surprised if e.g. the North Korean government runs some schemes like this (though not necessarily actually this) to bring in money.

But yes, definitely do the easy things first, like trying to stop e.g. grok from doing it and also going after users of e.g. grok who try to get around such efforts. A lot more crime happens than can be prosecuted, so raising the minimum competence threshold to commit crimes in the first place is very necessary.

Re: Deepfakes Tore a High School Apart

#42

I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.

We need a way to prove what's real.

Re: Deepfakes Tore a High School Apart

#43

I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.

it functioned just fine for the past 50 years. digital manipulation of media had always been possible. americans simply didn't have a society-wide psychosis during the early days of personal computing and Internet.

It took some skill and time before to make anything passable as realistic. Enough skill and time to defeat a teenagers motivation. That's the difference.

"make the person in this photo naked. No mistakes"

Prompts lowered the bar. Even if you do have to install a local text to image model.

Re: Deepfakes Tore a High School Apart

#44

This is sadly becoming very common and they are worringly good enough for people to assume they are real. I had a friend who had this issue, she has tried to ride it off as no clue who made them or shared them but I know it can't be easy for her. There needs to be appropriate laws for this the same way there is for revenge porn etc.

Surely this comes under defamation law or something similar, as if they photoshopped the girl's heads onto porn photos.

Re: Deepfakes Tore a High School Apart

#45
post #26

I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.

Hopefully we’ll get back to the time back when people didn’t have to worry about someone filming them all the time. Cameras cryptographically signing all photos and videos should become the standard. Media that cannot be traced back to real camera hardware should a priori be considered fake or tampered with. Still, deepfakes are partly a social problem and, as should be well known, social problems can rarely be solve…

This is another example of treating normal behaviour as criminal. Like banning VPNs or age verification.

How about we undo the radical individualism that has rotted out any compassion and empathy from society in the pursuit of greed? Not as easy to do granted, but it's a social technical debt that can't be quick fixed.

Re: Deepfakes Tore a High School Apart

#46
post #21

This kind of behavior should be met with swift and strong reaction from both the school authorities and the law enforcement. Kids responsible should be put on trial and face serious consequences including jail time for most egregious cases. Let the news cover it nationwide. "This is what will happen if you even think about creating and circulating nude pics of anyone" should be the message sent. This is the only way…

It used to be that if you wanted to see people naked you’d just use your imagination. If you really wanted you’d draw or use photoshop, but both actually required skill. AI made it too easy. Teenagers wanting to see each other naked is normal and part of the human experience.

I don’t agree with the nanny state approach. America is already too obsessed with violence being ok and any kind of sex/nudity being completely evil. I don’t have an actual answer but having a moral panic over it is not the solution.

Re: Deepfakes Tore a High School Apart

#47
post #2

Didn't get past the paywall but, recently a friend had their primary school targeted by blackmailers who took public photos of children and made (I'm told) extremely explicit images with them, threatening to release them if not paid. What's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel. Don't post innocuous…

That is propagation of CSAM. We already have way of dealing with people transmitting CSAM, that is to prosecute them heavily.

You won't prevent people stabbing others with knife by banning knife or asking people to wear knife-proof vest going outside. You deter them by making everybody know that the consequence of harming somebody else is going to be a very unpleasant experience.

Re: Deepfakes Tore a High School Apart

#48
post #21

This kind of behavior should be met with swift and strong reaction from both the school authorities and the law enforcement. Kids responsible should be put on trial and face serious consequences including jail time for most egregious cases. Let the news cover it nationwide. "This is what will happen if you even think about creating and circulating nude pics of anyone" should be the message sent. This is the only way…

I do agree that shit behavour should be met with direct reaction but lets be honest here the time and effort of doing this is 5 minutes. A proper society should educate people about things they can't get rid of anymore. And no you can't just put teenager, which have not fully formed brains yet, into prison for fake nudity

I agree here. People are too quick to levy adult punishment and morality against children.

Teach them compassion and empathy. Teach them why their actions hurt.

Re: Deepfakes Tore a High School Apart

#49
post #27

Earlier quoted context omitted.

Back in my father's day you'd get executed for drawing a dick on Stalin's forehead. It's nice to see people still care more about symbolic violence than actual violence.

These are teenage girls, not adult men. This isn’t graffiti, but highly realistic sexual depictions. There’s a massive difference.

Nevertheless there is almost a moral equivocation between images of sex and actual sex by some people. We are talking about restraining someone physically inside a 2 by 3 meter box for multiple years as a retribution for what is after all just pixels on a screen.

(And by the way the implicit comparison here between an image of stalin and an image of a teenage girl is more apt than most would care to admit given the ideological function fulfilled by sexualized images of young women in contemporary American society)

Re: Deepfakes Tore a High School Apart

#50

I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.

Perhaps there is reason to be optimistic. If we believe nothing online, then digital inauthenticity may cause us to yearn more for authentic, in-person interactions. The modern web has not been without its warts. It's led society to some very unhealthy behaviors. It's telling that a lot of people think the internet is society, rather than a slice of it. Perhaps its decline is the correction society needed. It's easy…

A major problem with a culture of distrust is that bad actors doing bad things get impunity by telling everyone that what they did was fake.

It’s already been tried, when deepfakes weren’t even that good.

https://www.theguardian.com/technology/2023/apr/27/elon-musk...

Post reply on HN