Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-Assisted Fake Porn Is Here

motherboard.vice.com

Post reply on HN
Print view View original

61–70 of 110 posts

Re: AI-Assisted Fake Porn Is Here

#61

Post by tree_of_item »

anigbrowl wrote: post #57
tree_of_item wrote: post #45

Earlier quoted context omitted.

Should the people who discovered a way to start fires have come up with a way to prevent arson? Could they?

The negative externality of fire isn't arson, it's uncontrolled burning. Once you know water extinguishes fires, that's something to think about the next time you start one. The thing is, we know what externalities are and how they play out in regards to technology, even if we can't fully predict them. It's trivial to infer that this technology could be abused for deception, and that some sort of authentication techn…

I just don't understand how they can be expected to provide this, though. This "authentication technology" might not even exist, and in any case is very likely to be wildly different from the editing tech.

The editing tech in the OP is also off-the-shelf components, i.e. nothing was invented, just assembled in to the correct form. What exactly are they supposed to have done, just not posted anything about it until they found a way to thwart the technique they just discovered? Most likely this bottoms out in an arms race, so they'd be waiting forever.

Your request seems really absurd and I've never seen technological innovation work like this.

Re: AI-Assisted Fake Porn Is Here

#62

Post by prawn »

smallnamespace wrote: post #43
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

> The ultimate loser there is the truth, sadly. No, it will force the development of AI to detect whether things are fake or not. We'll soon be in an arms race as better-and-better AIs alternately try to fool or not be fooled. The people who are able to understand and wield these technologies will have incredible amounts of power over those who are not. This is one route to the singularity - to deal with the conseque…

I think we're already seeing a lot of cases where even AI to detect fakes will be irrelevant if the viewer wants to believe or ignore the alternative.

Re: AI-Assisted Fake Porn Is Here

#63

Post by dogecoinbase »

tree_of_item wrote: post #45
anigbrowl wrote: post #41

Earlier quoted context omitted.

With great power comes great responsibility. If you want to make money or social capital out of providing some innovation, you have some obligation to think about the negative externalities that will result and come up with a way to minimize them.

Should the people who discovered a way to start fires have come up with a way to prevent arson? Could they?

If structures had existed at the time, sure.

Re: AI-Assisted Fake Porn Is Here

#64

Post by qbrass »

sudouser wrote: post #29
amelius wrote: post #14

Earlier quoted context omitted.

Hey, this could actually be awesome. Everybody could make their own preferred version of the movie. Movie studios could get away with legal problems just by releasing videos without the faces, and letting the audience download faces through gray market channels.

Star Wars XVII, acted by: Adam Sandler!

It's just Happy Gilmore with lightsabers.

Re: AI-Assisted Fake Porn Is Here

#65

Post by Retric »

nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

This is about half way to a block chain.

The normal risk is the service simply replaces an old hash for video with a new hash secretly. However, if you put data + old hash you can create a long verifiable chain and someone can record a specific block and know the chain is unchanged from the point they saved a specific hash.

Re: AI-Assisted Fake Porn Is Here

#67

Post by tree_of_item »

dogecoinbase wrote: post #63
tree_of_item wrote: post #45

Earlier quoted context omitted.

Should the people who discovered a way to start fires have come up with a way to prevent arson? Could they?

If structures had existed at the time, sure.

And how would they do this? Should they have tried to keep fire secret until this problem was solved?

Re: AI-Assisted Fake Porn Is Here

#68

Post by iamben »

Despite some comments here, I don't thing society will adjust to this for a long time, if ever. We already live in a world where you can create bias with words on a page or a website, moreso if they come via someone with influence.

Imagine an AI generated 5 second clip of Weinstein saying something scandalous about raping women, or imagine Trump retweeting _anything_. People choose to believe something that fits with or reinforces how they think - emotion and reaction is easier than checking if something is true. Even if it's reported to be a fake after, people would rather question the reporting ("well that's what he'd want you to believe" / "of course they'll report it as a fake") than acknowledge the fake.

I hate to be a harbinger of trouble, but I can see a lot of people having their lives destroyed with this.

Re: AI-Assisted Fake Porn Is Here

#69

Post by paulryanrogers »

ekimekim wrote: post #8
rndmize wrote: post #4

Contrary to the article's stance that this would be used to create fake revenge porn or celebrity sex tapes that are taken as real, I'd expect this to devalue the real thing and give space for people to claim anything with their face in it is fake.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

Did you mean "less falsifiable"?

Re: AI-Assisted Fake Porn Is Here

#70

Post by acdha »

nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

At least Nikon has offered a similar idea for awhile:

http://imaging.nikon.com/lineup/software/img_auth/index.htm

The catch is that it has been hacked before:

https://blog.elcomsoft.com/2011/04/nikon-image-authenticatio...

The Secure Enclave helps a lot but the Nikon hsck illustrates a hazard of needing devices to be updated, especially since there’s an obvious opening for someone to use a plausible old vulnerable device – and it seems like, say, a compromising photo of a politician would spread a lot further and faster than the observation that the older phone has been compromised.

One other challenge is that you might be able to prove that a device took the photo but not that, say, it was a real scene rather than a high quality print or that the time stamp wasn’t subject to a manually set clock. Again, I’d expect countermeasures but worry that nobody would see them in time for the most damaging cases.

Post reply on HN