Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-Assisted Fake Porn Is Here

motherboard.vice.com

Post reply on HN
Print view View original

51–60 of 110 posts

Re: AI-Assisted Fake Porn Is Here

#51

Post by fancyPantsZero »

clickok wrote: post #36

I am disappointed in the level of fear-mongering pearl clutching; it could[0] get so much worse! First, the person creating the fakes is using an off-the-shelf algorithm[1], adapted accordingly. A system designed purely for the purpose of swapping faces (or morphing a particular face into others, one-to-many style) would obviously yield improvements. Secondly, it's the work of one person without commercial backing[2]…

> How about something more realistic, like character assassination campaigns?

if fake porn does become ubiquitous as you argue, wouldn't the impact of such assassination be greatly diminished?

Re: AI-Assisted Fake Porn Is Here

#52

Post by dynofuz »

smallnamespace wrote: post #43
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

> The ultimate loser there is the truth, sadly. No, it will force the development of AI to detect whether things are fake or not. We'll soon be in an arms race as better-and-better AIs alternately try to fool or not be fooled. The people who are able to understand and wield these technologies will have incredible amounts of power over those who are not. This is one route to the singularity - to deal with the conseque…

a lot of this stuff is already generated using generative adversairal networks, so i think the AI to fool is just as good as the one thats trying not to be fooled by design.

Re: AI-Assisted Fake Porn Is Here

#53

Post by telesilla »

pjc50 wrote: post #19
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

Indeed. The worst use of this will be forged political speeches. What happens when you can fake any video of anyone saying anything and then feed it to the social media outrage machine?

As the parent noted, society will adjust expectations about how to determine facts. When radio first came along, some people were fooled that Orson Welles's War of the Worlds [1] was actually happening, because it was in the style of a news broadcast. We learn and adjust how to process data as systems change around us.

https://www.smithsonianmag.com/history/infamous-war-worlds-r...

Re: AI-Assisted Fake Porn Is Here

#54

Post by rspeer »

nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

Well, it wouldn't help much with the topic of this article.

Maybe cryptographically verifying that a porn video happened is someone's fetish, but I don't think most people involved in the production or consumption of porn would care.

Re: AI-Assisted Fake Porn Is Here

#55

Post by wisty »

pjc50 wrote: post #19
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

Indeed. The worst use of this will be forged political speeches. What happens when you can fake any video of anyone saying anything and then feed it to the social media outrage machine?

You can already fake a political speech if you've got the resources. A look-alike and a good make-up artist can do a lot. The danger isn't a really good fake that can be discussed, but a high volume of OK fakes.

Re: AI-Assisted Fake Porn Is Here

#56

Post by [deleted] »

PeterisP wrote: post #33
Scarblac wrote: post #10

So, soon men will start editing themselves into videos as the male actor, for private use.

Men will start paying for a service that will create custom porn by swapping in the object of their fantasies. The only difficulty with choosing your hot neighbor instead of someone popular will be that the service will have to fetch their face from their facebook profile.

[deleted]

Re: AI-Assisted Fake Porn Is Here

#57

Post by anigbrowl »

tree_of_item wrote: post #45
anigbrowl wrote: post #41

Earlier quoted context omitted.

With great power comes great responsibility. If you want to make money or social capital out of providing some innovation, you have some obligation to think about the negative externalities that will result and come up with a way to minimize them.

Should the people who discovered a way to start fires have come up with a way to prevent arson? Could they?

The negative externality of fire isn't arson, it's uncontrolled burning. Once you know water extinguishes fires, that's something to think about the next time you start one.

The thing is, we know what externalities are and how they play out in regards to technology, even if we can't fully predict them. It's trivial to infer that this technology could be abused for deception, and that some sort of authentication technology might help to prevent that. So the responsible thing to do would be to provide both the editing and authentication technologies at the same time, even if neither is perfect.

Re: AI-Assisted Fake Porn Is Here

#58

Post by xster »

PeterisP wrote: post #33
Scarblac wrote: post #10

So, soon men will start editing themselves into videos as the male actor, for private use.

Men will start paying for a service that will create custom porn by swapping in the object of their fantasies. The only difficulty with choosing your hot neighbor instead of someone popular will be that the service will have to fetch their face from their facebook profile.

They can sell a LinkedIn Premium equivalent service.

X people used your face as a swap in for a pornstar. Y$ a month and you can see which state they're from. Z$ to meet the top 10 reviewed individuals near your zip code.

Re: AI-Assisted Fake Porn Is Here

#59

Post by DiThi »

nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

Sounds like a good idea, if you also receive a freshly made hash: to ensure the picture was taken _after_ the received hash and _before_ it was sent out.

I would make a merkle-tree-like hash to be able to obscure parts of the picture and still be able to prove the date.

Re: AI-Assisted Fake Porn Is Here

#60

Post by DiThi »

rspeer wrote: post #54
nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

Well, it wouldn't help much with the topic of this article. Maybe cryptographically verifying that a porn video happened is someone's fetish, but I don't think most people involved in the production or consumption of porn would care.

It may help e.g. if the original person has an alibi at the time the fake one was made, or to distinguish which of two version came first.
Post reply on HN