Live data from Hacker News

South Park creators have new political satire series with AI-generated deepfakes

theregister.com

181–190 of 313 posts

Re: South Park creators have new political satire series with AI-generated deepfakes

#181

This is SO GREAT! I often feel deep existential dread about deepfakes and the lag between when they are viable (now) and when everyone stops trusting video that doesn't have some kind of rock-solid signed/encrypted/testified provenance (years from now or never?). What better way to educate the public about deepfake technology than with over-the top satire?

I agree 100%. Deepfake hysteria is absurd. I'm the author of https://vo.codes , and my goal has been to make deep fakes as accessible as possible so people become familiar with them. You know what people use vo.codes for? Memes. That's it. A number of journalists have decided the technology is entirely confusing and deceitful. While there are new risks posed by deep fakes, I believe the potential for good far outweig…

"You know what people use vo.codes for? Memes. That's it."

Not really. Browsing the dark corners on 4chan and reddit, you'll often find people posting pictures of real people and asking if someone can put them into a deepfake.

Re: South Park creators have new political satire series with AI-generated deepfakes

#182
post #177

I think the biggest casualty of deepfakes are going to be citizens. Record a video of police brutality or crime footage and it can all be shrugged off as a deep fake. TV stations and journalists can afford 'signed videos'.

The type of person who will claim that has already been claiming 'false flag' or 'fake news' anyways.

If someone has confirmation bias, they're still going to find ways to call it fake with or without deep fake tech.

Re: South Park creators have new political satire series with AI-generated deepfakes

#183
post #171

Earlier quoted context omitted.

I agree 100%. Deepfake hysteria is absurd. I'm the author of https://vo.codes , and my goal has been to make deep fakes as accessible as possible so people become familiar with them. You know what people use vo.codes for? Memes. That's it. A number of journalists have decided the technology is entirely confusing and deceitful. While there are new risks posed by deep fakes, I believe the potential for good far outweig…

> It is difficult to get a man to understand something, when his salary depends on his not understanding it. ― Upton Sinclair

I'm not sure if this is directed at me or the media.

If it's at me, I could just as well be building anything else. I find this technology fascinating, and I see an almost magical future ahead where we can tweak sensory input and play it like an instrument.

It's the closest we've come to building our dreams. The possibility of the The Matrix made more real, and bent to our own desires.

This stuff is going to sink Hollywood and replace it with an improvement at least an order of magnitude more imaginative.

So it's not that I'm letting personal interest or profit motives cloud my judgment. I think this is truly revolutionary, and I don't understand why others don't see the same glittering and fantastical future.

They're too afraid of the demons to build the cool thing.

Re: South Park creators have new political satire series with AI-generated deepfakes

#184
post #177

I think the biggest casualty of deepfakes are going to be citizens. Record a video of police brutality or crime footage and it can all be shrugged off as a deep fake. TV stations and journalists can afford 'signed videos'.

It will be much more difficult to do deepfakes of that sort. Doing a good deepfake requires lots of training data. We might be able to get away with less training data a the tech progresses, but that is one area that will probably be most difficult to make progress in.

Re: South Park creators have new political satire series with AI-generated deepfakes

#185

I understand the worries behind deep fakes, but i'm going to be a bit facetious here, hasn't getting the most realistic, lifelike images always been the goal of computer graphics? Wouldn't deepfakes be the ultimate culmination of lifelike CGI. So lifelike it's indistinguishable from the real thing? Like for most of my life, this is the goal I keep hearing about. Now it's here, suddenly it's too real. I dunno just see…

Deep fake is photoshop for video and audio. Alarmists are going to opine the many ways it will cause the sky to fall but life will continue.

Re: South Park creators have new political satire series with AI-generated deepfakes

#186
post #177

I think the biggest casualty of deepfakes are going to be citizens. Record a video of police brutality or crime footage and it can all be shrugged off as a deep fake. TV stations and journalists can afford 'signed videos'.

Seems like it would be pretty easy to add a way to sign a video using keys stored in a phone's enclave, surely Apple and Google are capable of doing so.

Re: South Park creators have new political satire series with AI-generated deepfakes

#188

This is SO GREAT! I often feel deep existential dread about deepfakes and the lag between when they are viable (now) and when everyone stops trusting video that doesn't have some kind of rock-solid signed/encrypted/testified provenance (years from now or never?). What better way to educate the public about deepfake technology than with over-the top satire?

"I often feel deep existential dread about deepfakes and the lag between when they are viable (now)"

But they still should be spottable as Fake, if examined.

Related, a MIT project to build a KI to spot deepfakes (also ways to spot deepfake as human):

https://www.media.mit.edu/projects/detect-fakes/overview/

Re: South Park creators have new political satire series with AI-generated deepfakes

#189

Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?

You can sign the data, but it won't help.

Basically, the ability to fake any video means that other data is needed to prove that the person/events in the video was in fact the person/events that that video is claimed to depict.

Other proof, other measurements of the same events, etc.

Deep fakes mean people will know they can't trust their eyes, they need to think critically. That's been true for a while, but now they'll know it.

Which I presume is why Parker/Stone are doing this now, other than the obvious (make money). They're going to force people to recognize this is possible and how perfect the fake can be.

Re: South Park creators have new political satire series with AI-generated deepfakes

#190

Earlier quoted context omitted.

This works in a courtroom. This won't work for a politician who retweets a faked video that then incites real violence. And that , at least for now, is where we truly need to be concerned.

> This works in a courtroom. Does it though? Suppose there is a theft at a company. The police go to the company's security team and get the surveillance footage. Presumably admissible. If it was an inside job, the surveillance footage could be a deepfake showing someone else committing the crime. Or maybe it's real surveillance footage. Without some way to distinguish the two, how do you know?

And a witness might lie. How will we manage?
Post reply on HN