Live data from Hacker News

AI-assisted fake porn are being used by people on Reddit for self-completion

linustechtips.com

41–50 of 128 posts

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#41
post #8
post #6

Outside of porn, I'm wondering if this could be used in other ways, e.g. government propaganda. Putting leaders in situations that make them look good or putting their opponents in compromising situations.

It not only can be, but it was https://www.youtube.com/watch?v=ApG1XdI-Dd4 there were a few months when JA didn't give any sign and people on /r/wikileaks started asking if he's still alive, then this video was posted. It's fake.

No, that video is real. Those are morph cuts.

https://www.youtube.com/watch?v=J6wPUtKg-Ac

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#42
post #24

Earlier quoted context omitted.

I think we’ll probably have to move to a model where any security footage or images that is used in court must be digitally signed at the hardware level, with a verification process similar to how CAs work now. Of course, this will still be tamperable, but tampering would have to be much more premeditated and sophisticated.

that is absolutely never going to be workable because you can just film another video being played back.

I can imagine watermarking at the light sensor level. It would need some very special provisions for compression, though.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#43

Earlier quoted context omitted.

And that’s why the use and mandating everyone uses their real and verified identity everywhere on the web is needed. You can still comment and post whatever anonymously but it won’t hold any weight!

That doesn't really make sense in this context; if someone is pretending to be you using your own face and voice, using real identities is kind of the point, isn't it?

Ummm but if it’s not you the uploader thru a verified ID system (block chain maybe) is held liable immediately. Also by the time such a system is out in place the public will be even more suspect of believing what they see on the net as truth. Such is already happening with those 40 and below in terms of finally waking up to all the fakery on the web. Just saw on FB a video where a girl crosses her eyes and they get stuck. Majority of commenters below 40 notes it’s fake. Above 40 commented otherwise.

Either we instate an ID system or the web becomes a joke no one believes. The latter I guess wouldn’t be a bad thing.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#44
post #42

Earlier quoted context omitted.

that is absolutely never going to be workable because you can just film another video being played back.

I can imagine watermarking at the light sensor level. It would need some very special provisions for compression, though.

Well, but then you'd have to trust the light sensor manufacturer to provide secure keys. Remember when the NSA hacked into Gemalto and had a chance to steal its SIM card keys?

However, that's still interesting; isn't it possible that each light sensor has certain watermark-like characteristics arising from the manufacturing process?

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#46
post #20
post #9

Earlier quoted context omitted.

Plausible deniability doesn't really work in real life though. Very few people are going to give you, or anyone accused of an indiscretion, the benefit of the doubt on the basis that a video might have been faked with AI. That is much less plausible than someone cheating and getting caught. If you think anyone is going to accept that a video is fake, even if it is , then you're woefully naive.

As someone with a generally cynical/pessimistic outlook I too, like blunte , want to see something positive in this. Hopefully, since it can't be stopped, it becomes so routinely used against so many people that everyone stops caring any more if it's real or fake. It's sad that our attitudes (if not behaviour) towards sex are still so fucked up and judgemental thanks to thousands of years of religious/Victorian/purit…

Western sexual revolution can be said to have happened little more than 50 years ago. Culture takes a lot of time to revert.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#47
post #24

Earlier quoted context omitted.

I think we’ll probably have to move to a model where any security footage or images that is used in court must be digitally signed at the hardware level, with a verification process similar to how CAs work now. Of course, this will still be tamperable, but tampering would have to be much more premeditated and sophisticated.

that is absolutely never going to be workable because you can just film another video being played back.

I mean, there are all kinds of ways to bound uncertainty. You’re right, you could film another camera, but that could be addressed separately. Digital signing would only prove that a video came directly from a particular camera’s sensors. To assert the veracity of a video, you’d then have to prove that particular camera was at the scene, and the light coming into the lens was authentic. Most court footage is incidental, not intentional, so the sort of doctoring you describe is unlikely in a majority of cases. Where it is likely, different measures could be taken to bound uncertainty.

Separately, generating false images or videos for libel purposes would become more difficult; if a camera that has never been owned by a person is used to produce a signed video that is pornographic in nature, the authenticity of that video is immediately suspect. It would take a much more sophisticated attack to produce a mathematically convincing fake video.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#48
I wonder if this will lead to a trend of people going to see events live, more often. Given that seeing something occur live is going to end up as the only "real way" to trust something to be true. Scary to think that reality has become questionable in itself.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#49
post #38
post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

The problem I see with tech like this is that it muddies the water for everyone. I find it very strange that technologies like the internet appear to have created a world with more ambiguity and less transparency than we've had before - mostly because people now can find support for any kind of belief online. Some people are either willing to learn or have learned how to get information from reputation based systems…

I think this is a fallacy. the olden days were way worse. to put in presepective Carrots improving vision is propaganda created by the british yet see how many people believed it. Humans inventing and accepting fake beliefs to comfort themselves was never a new thing. Governments gaslighting its own citizens is communist party 101. People always want to believe that yesterday was better and blame their problems on the new.

Re: AI-assisted fake porn are being used by people on Reddit for self-completion

#50
post #38
post #21

This is what's being accomplished by one amateur with a little bit of hardware. Imagine what will happen when you have professional services (legal or otherwise) making altered videos of whoever or whatever you want. Want court evidence of your wife cheating? Fake grainy hidden camera video. Want to discredit a politician? Here he is picking up a male escort and using racial slurs. These sorts of things could be used…

The problem I see with tech like this is that it muddies the water for everyone. I find it very strange that technologies like the internet appear to have created a world with more ambiguity and less transparency than we've had before - mostly because people now can find support for any kind of belief online. Some people are either willing to learn or have learned how to get information from reputation based systems…

We've always had to discuss what the facts are - the extreme bias between newspapers and TV channels picking and choosing facts to provide to their users, even on the same news stories - news source A chooses not to provide background info, news source B chooses to provide background info from one primary source only, news source C chooses to provide background info from another source, news source D chooses to provide a general overview but with a slight bent towards assuming that its readers hold values X, Y and Z, etc etc.

You can go back and read stories from the 1950s which have these issues and more. There has never been a time where all individuals involved in a democracy have understood all the facts. Popular politics has always been driven by newspapers and special interest groups.

In my country, implementation of a certain policy has very clear correlation with a marked increase in suicide rates - the slow rollout of this specific policy across areas of the country provides an easy way to show this. Certain newspapers refuse to report on this - it doesn't match their ideology - after all, when pointed out, people holding this ideology will often point out that suicide is one's own decision and it's not the Government's problem.

Post reply on HN