Live data from Hacker News

AI-Assisted Fake Porn Is Here

motherboard.vice.com

31–40 of 110 posts

Re: AI-Assisted Fake Porn Is Here

#31
post #13

There's also a fascinating RadioLab piece from a few months ago about this kind of thing: http://futureoffakenews.com/videos.html It's remarkable to me how little the ML researcher they interview in that episode seems willing to grapple with the consequences of the technology.

I heard that piece, but I read is less as "unwilling to grapple" and more "resigned to the fact that it is inevitable the technology will be built, so might as well enjoy myself building it".

It would feel a little grating to me as the interviewee to have the interviewer keep pressing me on these questions that, while totally relevant, are obviously designed to make me have to "answer for what I'm doing" in some Frankenstein-esque sense. Yeah, I get it, it's scary, but this train left the station a long, long time ago and probably I'm not (even as someone working on the tech) gonna have a lot to say about the downsides that haven't already been said.

Re: AI-Assisted Fake Porn Is Here

#32
Not exactly a new concept but it’s likely extremely cheap now and would even get cheaper and better.

With VR porn, the new sex toys for men and women and now this I’m somewhat happy that this wasn’t around when I was a teenager as I’m really not confident I would have left the room if that was available.

Re: AI-Assisted Fake Porn Is Here

#33

So, soon men will start editing themselves into videos as the male actor, for private use.

Men will start paying for a service that will create custom porn by swapping in the object of their fantasies. The only difficulty with choosing your hot neighbor instead of someone popular will be that the service will have to fetch their face from their facebook profile.

Re: AI-Assisted Fake Porn Is Here

#35

I'm imagining the value for making actual theatre movies will be a bigger issue. You can have Humphrey Bogart in a science fiction thriller! We'll have to come up with new rules.

This is essentially the starting plot of The Congress. Not exactly a good movie, but definitely a very interesting one.

more like 1981 Looker

Re: AI-Assisted Fake Porn Is Here

#36
I am disappointed in the level of fear-mongering pearl clutching; it could[0] get so much worse!

First, the person creating the fakes is using an off-the-shelf algorithm[1], adapted accordingly. A system designed purely for the purpose of swapping faces (or morphing a particular face into others, one-to-many style) would obviously yield improvements.

Secondly, it's the work of one person without commercial backing[2]. A studio that invested in lidar or used multiple cameras would be able to incorporate volumetric information.

Third, it's limited to individuals where you have a performer that's an approximate body double for the target in question. Why involve real people at all? That limits the kinds of scenes you'll be able to shoot, and it's clearly a production bottleneck besides. Since it's feasible to create realistic animations of locomotion via deep reinforcement learning[3], applying the same technique would remove the need for human actors.

With that in mind, we can invent scenarios substantially more terrifying, for which this is but a teaser trailer.

As computation becomes cheaper and AI knowledge more widespread, the delay between when something becomes possible and when it becomes ubiquitous grows ever shorter. Once custom pornography is just another something-as-a-service, the question becomes how do we optimize it? IoT sensors and wearables can provide the data needed to customize an experience tailored to your particular tastes on a moment-by-moment basis. Facebook is sinister, but it's sinister in the sense of a malevolent external force with inscrutable goals; you can defeat it by not using Facebook. The idea of a machine that can produce something more compelling than most stimuli available in the external world is scarier, because all it would be doing is giving you exactly what you want.

Okay, so the riff on wireheading in the style of Infinite Jest might not be adequately terrifying. How about something more realistic, like character assassination campaigns? We've seen how intimations of sexual impropriety can damage a politician's electoral chances or outright cause them to resign. Sometimes, the thing that allows them to hold on to office is the fact that there's no convincing proof beyond circumstantial evidence. However, if you've already primed the public with rumors, a fake sex tape might be the just the thing to push past the tipping point. Imagine: a future where an individual could effect a bloodless coup using nothing more than a Twitter botnet to spread slander and a few GPUs to generate scandalous footage.

No? That's perhaps more in the vein of William Gibson. The last thought that came to mind was along the lines of "the future is weird and terrible, yet somehow boring and familiar" a la Neal Stephenson. The redeeming value of porn is that there's at least some intentionality behind it. Real people had to be involved, from the actors to the crew to the guy who wrote the script in traffic on the way to the shoot. The future will be endless porn spam, half-coherent plots generated by LSTM-char, just glitchy enough to be discernible as fake, yet seemingly unavoidable due to the sheer quantity made possible by automating the production pipeline.

------

0. And when it comes to AI, "could" should be read as "will" but with an indeterminate time frame.

1. Apparently, the face-swapping is accomplished following "Unsupervised Image-to-Image Translation Networks" (paper: https://arxiv.org/abs/1703.00848 video: https://www.youtube.com/watch?v=Bwq7BmQ1Vbc), with the face detection provided by FasterRCNN.

2. The reddit account of the artiste in question: https://www.reddit.com/user/deepfakes (not exactly safe for work, but not particularly unsafe, either).

3. http://www.cs.ubc.ca/~van/papers/2017-TOG-deepLoco/

Re: AI-Assisted Fake Porn Is Here

#37

Truth is going to be destroyed in the AI hyper reality. We are going to need technological solutions to validate against ai forgeries for our legal system to survive.

We already have such tools. This is an example: http://fotoforensics.com/

An issue that the same algorithms that can be used to differentiate between real and fake can be used to train AIs to make better fakes. But here, the fake detector has the advantage in the arms race.

Another approach is to use cryptographic signatures. Some cameras sign can sign pictures to ensure they are original.

Re: AI-Assisted Fake Porn Is Here

#38
post #4

Contrary to the article's stance that this would be used to create fake revenge porn or celebrity sex tapes that are taken as real, I'd expect this to devalue the real thing and give space for people to claim anything with their face in it is fake.

Why not both?

Re: AI-Assisted Fake Porn Is Here

#39
post #25
post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

The truth can benefit greatly if the standard for fact checking changes. Media is not a great friend to truth, especially not when it conflict with either revenue or political direction. Just take the massive global interest in fact checking sites after the 2016 US election. It seems as a strong trend in competing with media for carrying the banner for truth, and the best part is that many such sites seems to have a…

Trolls seem to be doing just fine. It's also cool to be a fact checker but if you think the fakers have lost then you're naive, they're stronger than ever.

Re: AI-Assisted Fake Porn Is Here

#40

Earlier quoted context omitted.

Its really not so different than it was prior to the advent of radio. By the time news reached you about what some politician said it had gone through multiple people and could be altered in any number of ways. Sometimes intentionally and sometimes through misunderstanding.

I've suspected for a long time that much of what we know about history from written accounts is false.

This is a basic assumption historians take. They assume sources have biases and agendas, and try to figure out what is true. It isn't a perfect system, but no historian takes a source at face value.
Post reply on HN