Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-assisted fake porn are being used by people on Reddit for self-completion

linustechtips.com

Post reply on HN
Print view View original

31–40 of 128 posts

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#31

Post by SanFranManDan »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

All of this has been possible for the last century.

For instance, at least in Russia you just get an actor that looks like the politician, film them doing some bad stuff and blackmail them. Pretty simple.

We have had doctored photos/videos for as long as the mediums existed.

If anything it will saturate and you wont be able to tell what is real or not. Most people will default to "fake" and have to rely on the trustfulness of the source. Just like now. We have photoshop and there isn't mass chaos.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#32

Post by throwaway2048 »

beisner wrote: post #24
mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

I think we’ll probably have to move to a model where any security footage or images that is used in court must be digitally signed at the hardware level, with a verification process similar to how CAs work now. Of course, this will still be tamperable, but tampering would have to be much more premeditated and sophisticated.

that is absolutely never going to be workable because you can just film another video being played back.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#33

Post by chrisper »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

These days you don't even seem to need any evidence. An allegation seems to be enough to get you dethroned.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#34

Post by phinnaeus »

everdev wrote: post #29
mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

While the technique does make fraudulent videos easier to make, I don't see this in and of itself as that fatal to public trust. Faking content to hurt someone has been around forever. We then learned not to trust gossip, not to trust uncorroborated sources, etc. I hope it might actually help people be more skeptical of what they're reading and seeing. And hopefully it will help news media be more skeptical of their…

> We then learned not to trust gossip, not to trust uncorroborated sources, etc.

Somewhat ironically, I feel a citation is needed here.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#35

Post by Sir_Cmpwn »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

How long will it take for this approach to be used to splice people into child pornography? The court of public opinion might sentence the victim to maiming or death.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#37

Post by erikpukinskis »

squarefoot wrote: post #10
djhworld wrote: post #6

Outside of porn, I'm wondering if this could be used in other ways, e.g. government propaganda. Putting leaders in situations that make them look good or putting their opponents in compromising situations.

It could also be used as a convincing tool to dismiss any proof, even legit ones, as fabricated. More or less the equivalent of "Your honor, that picture (of a cop shooting an unarmed civilian) is clearly photoshopped!". I'm excited about the technology though concerned about possible abuses.

In the U.S, cops are allowed to shoot unarmed civilians, entirely at their discretion. We consider it a privilege of the position, bestowed in exchange for the risk they face. Video doesn’t affect the verdicts even when it is admitted.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#38

Post by jcfrei »

mabbo wrote: post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

The problem I see with tech like this is that it muddies the water for everyone. I find it very strange that technologies like the internet appear to have created a world with more ambiguity and less transparency than we've had before - mostly because people now can find support for any kind of belief online. Some people are either willing to learn or have learned how to get information from reputation based systems and some will just go rogue and create their own reality. I hope democracy survives this shift: Because not only will we have to discuss the facts, now we will also have to discuss: What are the facts?

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#39

Post by sverige »

phinnaeus wrote: post #34
everdev wrote: post #29

Earlier quoted context omitted.

While the technique does make fraudulent videos easier to make, I don't see this in and of itself as that fatal to public trust. Faking content to hurt someone has been around forever. We then learned not to trust gossip, not to trust uncorroborated sources, etc. I hope it might actually help people be more skeptical of what they're reading and seeing. And hopefully it will help news media be more skeptical of their…

> We then learned not to trust gossip, not to trust uncorroborated sources, etc. Somewhat ironically, I feel a citation is needed here.

#MeToo

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#40

Post by jstanley »

akerro wrote: post #8
djhworld wrote: post #6

Outside of porn, I'm wondering if this could be used in other ways, e.g. government propaganda. Putting leaders in situations that make them look good or putting their opponents in compromising situations.

It not only can be, but it was https://www.youtube.com/watch?v=ApG1XdI-Dd4 there were a few months when JA didn't give any sign and people on /r/wikileaks started asking if he's still alive, then this video was posted. It's fake.

That's fascinating!

There was also a livestream in which he supposedly gave a "proof of life" by reading out a bitcoin block hash, among other things.

Do you think that one was faked too?

Post reply on HN