Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-assisted fake porn are being used by people on Reddit for self-completion

linustechtips.com

Post reply on HN
Print view View original

21–30 of 128 posts

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#21

Post by mabbo »

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want.

Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used to start wars.

Sure, deeper analysis might prove that this video isn't real, but that won't stop the immediate public reaction and response. The knee-jerk reaction to what the public sees is the end-goal. I'll bet good money that this technology plays a major role in future elections.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#22

Post by DennisP »

onion2k wrote: post #9
blunte wrote: post #2

On the flipside, this gives anyone basic plausible deniability. No baby, that homemade porn video on my phone wasn't me! I just used a program to stick my face on something I found on the internet.

Plausible deniability doesn't really work in real life though. Very few people are going to give you, or anyone accused of an indiscretion, the benefit of the doubt on the basis that a video might have been faked with AI. That is much less plausible than someone cheating and getting caught. If you think anyone is going to accept that a video is fake, even if it is , then you're woefully naive.

That's true right now because video fakes are new and rare. Photoshop fakes have been around for years, and now when there's an apparent nude photo of someone famous, people generally assume it's fake unless there's a particular reason to believe it's real, such as a publicized hack.

On the other hand, video of an intimate partner may have enough behavioral cues so fakes aren't much of an issue, unless the attacker has started with video surveillance of the target.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#23

Post by digi_owl »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

> Want to discredit a politician? Here he is picking up a male escort and using racial slurs.

Worked so well in a recent election...

> These sorts of things could be used to start wars.

Wars have been started on much flimsier pretexts, unless you are talking about getting the other side so irate that they fire first.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#24

Post by beisner »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

I think we’ll probably have to move to a model where any security footage or images that is used in court must be digitally signed at the hardware level, with a verification process similar to how CAs work now. Of course, this will still be tamperable, but tampering would have to be much more premeditated and sophisticated.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#25

Post by Havoc »

djhworld wrote: post #6

Outside of porn, I'm wondering if this could be used in other ways, e.g. government propaganda. Putting leaders in situations that make them look good or putting their opponents in compromising situations.

>I'm wondering if this could be used in other ways, e.g. government propaganda.

Here you go: (SFW)

https://imgur.com/gallery/BEVmQXo

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#26

Post by paul7986 »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

And that’s why the use and mandating everyone uses their real and verified identity everywhere on the web is needed. You can still comment and post whatever anonymously but it won’t hold any weight!

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#27

Post by alsetmusic »

bambax wrote: post #16
blunte wrote: post #2

On the flipside, this gives anyone basic plausible deniability. No baby, that homemade porn video on my phone wasn't me! I just used a program to stick my face on something I found on the internet.

Yes, exactly. > It isn’t difficult to imagine an amateur programmer running their own algorithm to create a sex tape of someone they want to harass. If it's trivial to fake a porn video with anyone's face on it, then the burden of proof is on the harasser to demonstrate how this one's real. Or you can take said video and put some famous people's face on it as a response. Also, the source video probably existed before…

> (And if you're facing an enemy that has enough ressources to shoot a specially-made porn video just to smite you, you have bigger problems to worry about).

While there may be a barrier to applying the technology after the fact, shooting a homemade video is something that can be accomplished by anyone with a modern smart phone.

In fact, if you want your fake porn to look authentic (for purposes of blackmail or otherwise), this is how you would do it. Then it could be claimed that it was self shot and leaked to the internet via a cloud “hack” or similar.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#28

Post by omeid2 »

beisner wrote: post #24
mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

I think we’ll probably have to move to a model where any security footage or images that is used in court must be digitally signed at the hardware level, with a verification process similar to how CAs work now. Of course, this will still be tamperable, but tampering would have to be much more premeditated and sophisticated.

The privacy implications of that would be scary. It seems on par with North Korea's Red Star Watermarking which has been dubbed as "dictator’s wet dream".

https://qz.com/583311/north-koreas-dissident-tracking-comput...

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#29

Post by everdev »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

While the technique does make fraudulent videos easier to make, I don't see this in and of itself as that fatal to public trust. Faking content to hurt someone has been around forever. We then learned not to trust gossip, not to trust uncorroborated sources, etc.

I hope it might actually help people be more skeptical of what they're reading and seeing. And hopefully it will help news media be more skeptical of their sources as well. If that doesn't happen then this will be a disaster.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#30

Post by ameister14 »

paul7986 wrote: post #26
mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

And that’s why the use and mandating everyone uses their real and verified identity everywhere on the web is needed. You can still comment and post whatever anonymously but it won’t hold any weight!

That doesn't really make sense in this context; if someone is pretending to be you using your own face and voice, using real identities is kind of the point, isn't it?
Post reply on HN