Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-Assisted Fake Porn Is Here

motherboard.vice.com

Post reply on HN
Print view View original

41–50 of 110 posts

Re: AI-Assisted Fake Porn Is Here

#41

Post by anigbrowl »

sushisource wrote: post #31
rflrob wrote: post #13

There's also a fascinating RadioLab piece from a few months ago about this kind of thing: http://futureoffakenews.com/videos.html It's remarkable to me how little the ML researcher they interview in that episode seems willing to grapple with the consequences of the technology.

I heard that piece, but I read is less as "unwilling to grapple" and more "resigned to the fact that it is inevitable the technology will be built, so might as well enjoy myself building it". It would feel a little grating to me as the interviewee to have the interviewer keep pressing me on these questions that, while totally relevant, are obviously designed to make me have to "answer for what I'm doing" in some Fran…

With great power comes great responsibility. If you want to make money or social capital out of providing some innovation, you have some obligation to think about the negative externalities that will result and come up with a way to minimize them.

Re: AI-Assisted Fake Porn Is Here

#42

Post by anigbrowl »

clickok wrote: post #36

I am disappointed in the level of fear-mongering pearl clutching; it could[0] get so much worse! First, the person creating the fakes is using an off-the-shelf algorithm[1], adapted accordingly. A system designed purely for the purpose of swapping faces (or morphing a particular face into others, one-to-many style) would obviously yield improvements. Secondly, it's the work of one person without commercial backing[2]…

Imagine: a future where an individual could effect a bloodless coup using nothing more than a Twitter botnet to spread slander and a few GPUs to generate scandalous footage.

Turns out you don't really need the scandalous footage

Re: AI-Assisted Fake Porn Is Here

#43

Post by smallnamespace »

ekimekim wrote: post #8
rndmize wrote: post #4

Contrary to the article's stance that this would be used to create fake revenge porn or celebrity sex tapes that are taken as real, I'd expect this to devalue the real thing and give space for people to claim anything with their face in it is fake.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

> The ultimate loser there is the truth, sadly.

No, it will force the development of AI to detect whether things are fake or not.

We'll soon be in an arms race as better-and-better AIs alternately try to fool or not be fooled.

The people who are able to understand and wield these technologies will have incredible amounts of power over those who are not.

This is one route to the singularity - to deal with the consequences of ML and AI advancements, you need to invest even more. This ever-increasing arms race sucks vast amounts of human and financial capital into the 'tech sphere'.

Re: AI-Assisted Fake Porn Is Here

#44

Post by manicdee »

smallnamespace wrote: post #43
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

> The ultimate loser there is the truth, sadly. No, it will force the development of AI to detect whether things are fake or not. We'll soon be in an arms race as better-and-better AIs alternately try to fool or not be fooled. The people who are able to understand and wield these technologies will have incredible amounts of power over those who are not. This is one route to the singularity - to deal with the conseque…

Another option is that we will develop both cynicism about claims and care less about nudes/porn

Re: AI-Assisted Fake Porn Is Here

#45

Post by tree_of_item »

anigbrowl wrote: post #41
sushisource wrote: post #31

Earlier quoted context omitted.

I heard that piece, but I read is less as "unwilling to grapple" and more "resigned to the fact that it is inevitable the technology will be built, so might as well enjoy myself building it". It would feel a little grating to me as the interviewee to have the interviewer keep pressing me on these questions that, while totally relevant, are obviously designed to make me have to "answer for what I'm doing" in some Fran…

With great power comes great responsibility. If you want to make money or social capital out of providing some innovation, you have some obligation to think about the negative externalities that will result and come up with a way to minimize them.

Should the people who discovered a way to start fires have come up with a way to prevent arson? Could they?

Re: AI-Assisted Fake Porn Is Here

#46

Post by psergeant »

ekimekim wrote: post #8
rndmize wrote: post #4

Contrary to the article's stance that this would be used to create fake revenge porn or celebrity sex tapes that are taken as real, I'd expect this to devalue the real thing and give space for people to claim anything with their face in it is fake.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

I started pursuing a PhD application on this topic, speaking to a couple of potential supervisors, before losing interest.

Ideas: https://github.com/pjlsergeant/multimedia-trust-and-certific...

Re: AI-Assisted Fake Porn Is Here

#47

Post by nickparker »

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck:

Secure enclave based verifiable recording devices.

So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings.

It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of data as "recordings" we demote those to arbitrary blocks of data, and anything you want to claim as verified truth needs a time-stamped hash proving what device took it, where it was taken, when, and that it hasn't since been modified.

Disclaimer: I'm the furthest thing from a crypto person, this just seems like a nice use case to me.

[0]: http://www.town-crier.org/

Re: AI-Assisted Fake Porn Is Here

#48

Post by frandroid »

dreta wrote: post #28
Scarblac wrote: post #10

So, soon men will start editing themselves into videos as the male actor, for private use.

Masturbating to yourself sounds pretty niche.

I thought he meant the unsolicited sending of one's own fake porn, for the incels who want to pretend they have a sex life...

Re: AI-Assisted Fake Porn Is Here

#49

Post by frandroid »

clickok wrote: post #36

I am disappointed in the level of fear-mongering pearl clutching; it could[0] get so much worse! First, the person creating the fakes is using an off-the-shelf algorithm[1], adapted accordingly. A system designed purely for the purpose of swapping faces (or morphing a particular face into others, one-to-many style) would obviously yield improvements. Secondly, it's the work of one person without commercial backing[2]…

> indeterminate time frame

30 years away!

Post reply on HN