Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deepfakes Tore a High School Apart

404media.co

Post reply on HN
Print view View original

71–80 of 146 posts

Re: Deepfakes Tore a High School Apart

#71

Post by pbhjpbhj »

bandrami wrote: post #15
ceheaaf wrote: post #2

Didn't get past the paywall but, recently a friend had their primary school targeted by blackmailers who took public photos of children and made (I'm told) extremely explicit images with them, threatening to release them if not paid. What's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel. Don't post innocuous…

In the US possession of CSAM is a strict-liability crime. If the models contain the data to produce it, the modelmakers should be liable.

Models don't have to contain imagery of a thing to produce imagery of that thing - the canonical example is the pelican riding a bicycle.

Model makers, arguably, are like pencil manufacturers but in a World of good artists.

I think you can hold people to account for what they help to create, but not what they have potential to do.

Now, if models were trained on any csam, of course, the model's owners should be held you account.

Re: Deepfakes Tore a High School Apart

#73

Post by b65e8bee43c2ed0 »

sirsinsalot wrote: post #43
b65e8bee43c2ed0 wrote: post #36

Earlier quoted context omitted.

it functioned just fine for the past 50 years. digital manipulation of media had always been possible. americans simply didn't have a society-wide psychosis during the early days of personal computing and Internet.

It took some skill and time before to make anything passable as realistic. Enough skill and time to defeat a teenagers motivation. That's the difference. "make the person in this photo naked. No mistakes" Prompts lowered the bar. Even if you do have to install a local text to image model.

very soon no one will takes these things seriously, And That's A Good Thing.

there are, for example, websites that host (among a myriad other such things) style-accurate pictures of every Disney princess being fucked in every way imaginable. 70 years ago something like this might have caused a similar moral panic, but now no one (rightfully) gives a shit. you see a picture of Cinderella with a dick up her ass, you know it wasn't drawn by Disney.

Re: Deepfakes Tore a High School Apart

#74

Post by dmos62 »

teaearlgraycold wrote: post #57
dmos62 wrote: post #25

> Throughout the night, whenever one of the speakers brought up holding Big Tech accountable, and specifically Apple and Google’s app stores, the crowd applauded. The framing bothers me. It's shifting responsibility away from kids and the community. Deepfakes didn't do anything: kids made and used deepfakes in destructive ways. Big tech sucks, you get no argument from me there. But, how do people so quickly get over…

That's crazy talk. You actually want the village to raise the children and have everyone well integrated and healthy?

You know, that is crazy. Disregard what I said. Down with big tech!

Re: Deepfakes Tore a High School Apart

#75

Post by cindyllm »

b65e8bee43c2ed0 wrote: post #73
sirsinsalot wrote: post #43

Earlier quoted context omitted.

It took some skill and time before to make anything passable as realistic. Enough skill and time to defeat a teenagers motivation. That's the difference. "make the person in this photo naked. No mistakes" Prompts lowered the bar. Even if you do have to install a local text to image model.

very soon no one will takes these things seriously, And That's A Good Thing. there are, for example, websites that host (among a myriad other such things) style-accurate pictures of every Disney princess being fucked in every way imaginable. 70 years ago something like this might have caused a similar moral panic, but now no one (rightfully) gives a shit. you see a picture of Cinderella with a dick up her ass, you kn…

[dead]

Re: Deepfakes Tore a High School Apart

#76

Post by pjc50 »

b65e8bee43c2ed0 wrote: post #73
sirsinsalot wrote: post #43

Earlier quoted context omitted.

It took some skill and time before to make anything passable as realistic. Enough skill and time to defeat a teenagers motivation. That's the difference. "make the person in this photo naked. No mistakes" Prompts lowered the bar. Even if you do have to install a local text to image model.

very soon no one will takes these things seriously, And That's A Good Thing. there are, for example, websites that host (among a myriad other such things) style-accurate pictures of every Disney princess being fucked in every way imaginable. 70 years ago something like this might have caused a similar moral panic, but now no one (rightfully) gives a shit. you see a picture of Cinderella with a dick up her ass, you kn…

Cinderella isn't going to complain because she's not a real person. The problem here is making and distributing fakes of specific real people.

Re: Deepfakes Tore a High School Apart

#77

Post by bandrami »

pbhjpbhj wrote: post #71
bandrami wrote: post #15

Earlier quoted context omitted.

In the US possession of CSAM is a strict-liability crime. If the models contain the data to produce it, the modelmakers should be liable.

Models don't have to contain imagery of a thing to produce imagery of that thing - the canonical example is the pelican riding a bicycle. Model makers, arguably, are like pencil manufacturers but in a World of good artists. I think you can hold people to account for what they help to create, but not what they have potential to do. Now, if models were trained on any csam, of course, the model's owners should be held y…

And I think it would be an interesting question of discovery to determine if the models were or weren't trained on CSAM. (Diffusors were trained on both pelicans and bicycles, you know...)

I still think there's a lot of legal and IP landmines lying in wait from the Hoover-esque pre-training eras

Re: Deepfakes Tore a High School Apart

#78

Post by Cthulhu_ »

arkh wrote: post #22
ceheaaf wrote: post #2

Didn't get past the paywall but, recently a friend had their primary school targeted by blackmailers who took public photos of children and made (I'm told) extremely explicit images with them, threatening to release them if not paid. What's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel. Don't post innocuous…

> What's the defense? Prosecuting every one of those blackmailers. If this kind of crime starts going into the "you're gonna get caught and jailed 100%" category, less people will try it.

What if the blackmailer is anonymous and abroad?

Re: Deepfakes Tore a High School Apart

#79

Post by noufalibrahim »

prodigycorp wrote: post #28
CalRobert wrote: post #20

I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.

Perhaps there is reason to be optimistic. If we believe nothing online, then digital inauthenticity may cause us to yearn more for authentic, in-person interactions. The modern web has not been without its warts. It's led society to some very unhealthy behaviors. It's telling that a lot of people think the internet is society, rather than a slice of it. Perhaps its decline is the correction society needed. It's easy…

I think there are generational aspects to this.

The older generation (gen-x) and before has been trained to believe traditional media (and by extension, anything that is published on a "website" and/or forwarded on Whatsapp). Images, pictures etc. add to the authenticity. Of course, it's easier to forward than to investigate and refute.

The younger generation is less influenced by this but also care less about generating and forwarding these. Most of these things are "just a joke". In a weird way, pushing out non-consensual nude of someone is the same as editing someone's face in a group photo with dog ears and sending it to a circle of friends.

I don't know what the solution is but this kind of thing erodes trust. Photographs used to be evidence that can be used to establish trust and we've been culturally conditioned to accept them that way. This takes a sledgehammer to that and it's not easy to untrain a whole society away from a deeply conditioned feeling so easily.

Re: Deepfakes Tore a High School Apart

#80

Post by noufalibrahim »

nunodonato wrote: post #52
CalRobert wrote: post #37

Earlier quoted context omitted.

Suddenly a polaroid feels better than any digital photo.

I've been leaning to more analog (and "old") stuff these days. Not sure if it's because I'm tired of all the crap online, or its a coincidence of getting older and missing the old times. Maybe a bit of both. But I really enjoy sitting in my living room and do nothing except listen to my record and cd player.

It's nice to have analog/real world hobbies to reset. My kids and I have picked up whittling. A few blocks of wood, a sharp knife, some sheets of sandpaper and time just slows down. Many others too. It's nice to be completely offline for an extended period of time.
Post reply on HN