Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI-Assisted Fake Porn Is Here

motherboard.vice.com

Post reply on HN
Print view View original

91–100 of 110 posts

Re: AI-Assisted Fake Porn Is Here

#91

Post by mc32 »

labster wrote: post #87
unholiness wrote: post #83

Earlier quoted context omitted.

You could have said the same thing about Photoshop. Journalism is as good as the integrity of the source. In places, you could argue that's systematically eroding. I don't think you can argue that fake videos are what will bring it down.

Journalism is as good as ever. It's easier than ever before to gather facts and verify sources. The problems faced are external to journalism: a losing business model, and government saying that journalists aren't trustworthy. But the integrity of the press is fine. There are less yellow outfits than there were a century ago, even.

You can say that but the press (whether because they have no money or they can't afford to be second with the hot news) is complicit in the perceived decline and real decline.

It used to be you had to have two independent sources before you took an individual source's word. Now rumor becomes newsworthy --it's like the Enquirer won.

They are also owned by big cos (Amazon, Conde Nast, Carlos Slim, Murdock, etc.) and have very clear biases. NOt that biases didn't exist before (Hearst papers) but on day to day stuff they played it pretty level. Now, they go for the incendiary whereas before they were focused on big issues --the issues that mattered to society at large rather than smaller divisive issues. But divisiveness gets you clicks.

Re: AI-Assisted Fake Porn Is Here

#92

Post by thomas_howland »

smallnamespace wrote: post #43
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

> The ultimate loser there is the truth, sadly. No, it will force the development of AI to detect whether things are fake or not. We'll soon be in an arms race as better-and-better AIs alternately try to fool or not be fooled. The people who are able to understand and wield these technologies will have incredible amounts of power over those who are not. This is one route to the singularity - to deal with the conseque…

That ignores the role of actual social networks and social proof in the construction of consensus reality. "Our" AI says it's real, and "your" AI says it's fake, and one can debate the margins - just as one debated whether it was metaphysically true that Clinton didn't have "sexual relations" with Lewinsky, or that Bush "lied" about Iraq.

Re: AI-Assisted Fake Porn Is Here

#93

Post by wruza »

jhayward wrote: post #20
amelius wrote: post #5

I already thought about this possibility a decade ago. Anyway, the world is going to be a strange place. I'm sure that soon, nobody will believe anything they didn't see with their own eyes.

It seems likely we are only one or two tech breakthroughs from not even being able to trust our own eyes. It's going to get strange.

Chances are that we overestimate the completeness of information coming from our own eyes, except for obvious extreme cases. People, actions and events may and do look not what they really are.

I mean, with the fall of eye-trust we will barely lose something important; it's only perception bias.

Re: AI-Assisted Fake Porn Is Here

#94

Post by wruza »

pjc50 wrote: post #19
ekimekim wrote: post #8

Earlier quoted context omitted.

We've already seen this with images and Photoshop. Society and their heuristics of belief will adjust as these new capabilities become widespread. What's more troubling is that as media becomes falsifiable, solid evidence of...well, anything, becomes hard to have. The ultimate loser there is the truth, sadly.

Indeed. The worst use of this will be forged political speeches. What happens when you can fake any video of anyone saying anything and then feed it to the social media outrage machine?

The question that concerns me more than Terminator- and Matrix-like scenarios is why we allow "the social media outrage machine" to exist in the first place. It is nothing more than a bunch of mostly uneducated opinions that create erratic views around the world of their M-sized subscriber sets.

Maybe this new tech will force people to bet their credibility on what they say and spread.

Re: AI-Assisted Fake Porn Is Here

#95

Post by nickparker »

acdha wrote: post #70
nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

At least Nikon has offered a similar idea for awhile: http://imaging.nikon.com/lineup/software/img_auth/index.htm The catch is that it has been hacked before: https://blog.elcomsoft.com/2011/04/nikon-image-authenticatio... The Secure Enclave helps a lot but the Nikon hsck illustrates a hazard of needing devices to be updated, especially since there’s an obvious opening for someone to use a plausible old vulnerable de…

The time stamp is handled on receipt of the hash by third parties in my mind, not by the originating device. Ideally the position component of the data would also be verified by 3rd parties, eg cell towers receiving the data add their own signatures so you know it was at least in the region it claims.

The high quality prints problem is more interesting. I’d hope that sort of trick would be detectable by inspection, but then we’re back to cat/mouse games with AI.

If we all switched to crypto verified light field photography, we could at least force hoaxsters to build dioramas :)

Re: AI-Assisted Fake Porn Is Here

#96

Post by dillondoyle »

brucephillips wrote: post #89
dillondoyle wrote: post #84

I've been thinking a lot about trust, reality, and sourcing. I wonder if we'll move towards cryptographically signing content and facts so we have a verification of legitimacy. Maybe a blockchain single source of truth, using tiered identity verification where one can accumulate identifiers and use this ID to sign content (biometrics, other verified IDs can vouch for your verification etc higher score = less risk of…

Probably not, since most news is derivative.

Yeah I think this source of truth/verification would have to be an economy where trust and truth is the capital. For instance the WaPo can sign an article or post and PolitiFact could sign the work as factual (allow for non-binary labels). Using the ID system mentioned above, anyone could vouch for something. NyTimes would have more capital compared to some ID with low history/verification. Of course selling trust like this produces problematic externalities so this system would need large scale to overcome bad actors - if it could at all.

Child works and reposts are problematic too. Maybe could nest below origin content in a blockchain. Obviously re-saving jpgs & different video wouldn't hash to original so maybe it's more like you're cryptographically signing a perma-linked piece of content which is archived in something like IPFS or on this single source of truth blockchain. Maybe this would need scale and uniformity to create content standards; common meta tags to standardize media (og:video -> ipfs:mp4). Hard to get to content outside of always changing format and code let alone dealing with content which has changed in substance. Much more difficult than just PGP sign a block of text!

Re: AI-Assisted Fake Porn Is Here

#97

Post by dillondoyle »

cuckcuckspruce wrote: post #88
dillondoyle wrote: post #84

I've been thinking a lot about trust, reality, and sourcing. I wonder if we'll move towards cryptographically signing content and facts so we have a verification of legitimacy. Maybe a blockchain single source of truth, using tiered identity verification where one can accumulate identifiers and use this ID to sign content (biometrics, other verified IDs can vouch for your verification etc higher score = less risk of…

Can't wait to tell my (future, 10-15 years from now or so) kids stories about the Internet from when I was a kid and have them ask, "daddy, is it really true that you could post on the internet without giving a blood sample, retinal scan, and fingerprints to your ISP and didn't have to tie your real name and address to all of your comments?".

Lol. I refuse to use the face scanner on my new iPhone for similar ideological reasons. But we also already do this across platforms: TW verified, banks/Coinbase verification using IDs etc.

Re: AI-Assisted Fake Porn Is Here

#98

Post by Scarblac »

xster wrote: post #58
PeterisP wrote: post #33

Earlier quoted context omitted.

Men will start paying for a service that will create custom porn by swapping in the object of their fantasies. The only difficulty with choosing your hot neighbor instead of someone popular will be that the service will have to fetch their face from their facebook profile.

They can sell a LinkedIn Premium equivalent service. X people used your face as a swap in for a pornstar. Y$ a month and you can see which state they're from. Z$ to meet the top 10 reviewed individuals near your zip code.

This guy is really into you! Except he adjusted the width of your hips, decreased your breast size, got rid of the tattoos and went for mixed nigerian / inuit race, the latest fad. This is only 65% of the typical customization level!

Send a message? [Y/n/generate] Adjust profile picture to his preferences? [Y/n/half way there]

Re: AI-Assisted Fake Porn Is Here

#99

Post by breakingcups »

nickparker wrote: post #47

This reminds me of a crypto application I've been waiting for someone to build / explain why it would suck: Secure enclave based verifiable recording devices. So, a camera that uploads a signed hash of every image it takes using mobile connectivity as soon as it takes it. Or the same for video and audio recordings. It's loosely inspired by Town Crier[0]. The notion is that instead of regarding arbitrary blocks of dat…

What prevents me from pointing this camera at a 4k screen?

Re: AI-Assisted Fake Porn Is Here

#100

Post by breakingcups »

GuB-42 wrote: post #37
djroomba wrote: post #12

Truth is going to be destroyed in the AI hyper reality. We are going to need technological solutions to validate against ai forgeries for our legal system to survive.

We already have such tools. This is an example: http://fotoforensics.com/ An issue that the same algorithms that can be used to differentiate between real and fake can be used to train AIs to make better fakes. But here, the fake detector has the advantage in the arms race. Another approach is to use cryptographic signatures. Some cameras sign can sign pictures to ensure they are original.

I can point the camera at a high-resolution screen or printed out photo though.
Post reply on HN