Live data from Hacker News

South Park creators have new political satire series with AI-generated deepfakes

theregister.com

101–110 of 313 posts

Re: South Park creators have new political satire series with AI-generated deepfakes

#102

Earlier quoted context omitted.

I’ve said it here before and I’ll say it again: Audio and video evidence isn't admissible because it's audio or video (and may be inadmissible nonetheless). It's admissible because someone testifies under oath that they have personal knowledge of its provenance. The burden is on the party introducing the evidence to show that it's reliable, and the question of whether or not it is indeed reliable is a factual one for…

But the jury are humans. Should we be confident that a jury of 12 (if in US) can pretend that really convincing deepfakes should not be trusted? Especially when this form of evidence has been trustworthy for a decent chunk of time?

If no one can testify about the video’s provenance, then it simply won’t be admitted into evidence. If someone commits perjury in order to get the video admitted, the jurors will be the least of the problems.

Re: South Park creators have new political satire series with AI-generated deepfakes

#103
post #69

Let's remember their politics, though - they used to market themselves as "both sides are bad" indpendants/libertarians, but now they're full-out Trumpers. I could see clips from this show making the rounds on lower-information parts of social media like Facebook that are already prone to being hoodwinked by conservative fake news like Alex Jones and the like. Professionally-produced deepfakes becoming the exact atta…

Sassy Justice is one long gut-shot against Trump. I'm not sure why you think conservatives would widely share this, unless you're supposing that they have a good sense of humour and humility.

And yes, all politics and public figures warrant criticism and satire. Cast aside your sacred cows.

Re: South Park creators have new political satire series with AI-generated deepfakes

#104
post #89

Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?

It's a good question, crytpo can be used for this sort of thing. It does preclude editing, unless you also establish a cryptographic trust chain where each successive editor also has a trusted key. Probably never going to work with cameraphone journalism, but if we're talking about newsroom & press conference footage you could make it happen.

Why not? Can't there be "TLS for cameras"?

Re: South Park creators have new political satire series with AI-generated deepfakes

#105
post #21

Earlier quoted context omitted.

True, but photoshop is usually done by hand. An AI-generated deepfake could maybe eventually be trained so that it outputs videos that are indistinguishable from the real thing.

The detection side also gets the benefits of AI though. I can't see the generation side getting that far ahead.

> I can't see the generation side getting that far ahead.

How far ahead do they need to be?

Suppose that it's cat and mouse, at least initially. Every six months someone comes up with a new way to detect the best known deepfakes, then six months after that there is a new way to evade that means of detection as well.

Someone drops a deepfake five weeks before an election.

Re: South Park creators have new political satire series with AI-generated deepfakes

#106

This is SO GREAT! I often feel deep existential dread about deepfakes and the lag between when they are viable (now) and when everyone stops trusting video that doesn't have some kind of rock-solid signed/encrypted/testified provenance (years from now or never?). What better way to educate the public about deepfake technology than with over-the top satire?

Agree, video has always been a deeply manipulative media. Between editing, angles of shooting, music. The simple fact that you have a voice over that tells you something and that somehow because you are watching the video (what you watch is real) the voice over is also the truth.

It will introduce a healthy dose of skepticism to that media.

Re: South Park creators have new political satire series with AI-generated deepfakes

#107

Earlier quoted context omitted.

This works in a courtroom. This won't work for a politician who retweets a faked video that then incites real violence. And that , at least for now, is where we truly need to be concerned.

The onus of responsibility is still on the person doing the violence. Contrary to the fearmongering, I'd say deepfakes will just make people not believe things they read on the Internet (again), especially as the technology becomes more widespread.

Where the ultimate onus of responsibility falls doesn't matter much when you've got a bunch of Rohingya hanging from trees because some politician retweeted a fake video.

Re: South Park creators have new political satire series with AI-generated deepfakes

#108
post #90

This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…

How is that different from photoshop? Today no one trusts a photo, as even a teenager can do a decent fake on a smartphone. Now the same for audio and video. Doesn't change our world.

What? There are obvious examples where faked video can have a serious affect. What kind of solipsistic nightmare are we slipping into?

Re: South Park creators have new political satire series with AI-generated deepfakes

#109
The ramifications for misuse are real BUT

I think making a studio that specializes in this type of work is genius. This technology could really change the industry in interesting ways. Faster iteration, less re-shoots, less extras.

I guess you could even "storyboard" with rough deepfakes.

Pretty interesting stuff. I wonder what else people will come up with if this stuff becomes a shrink wrapped industry standard.

Re: South Park creators have new political satire series with AI-generated deepfakes

#110
post #90

Earlier quoted context omitted.

How is that different from photoshop? Today no one trusts a photo, as even a teenager can do a decent fake on a smartphone. Now the same for audio and video. Doesn't change our world.

What? There are obvious examples where faked video can have a serious affect. What kind of solipsistic nightmare are we slipping into?

Because people still have some faith in videos. Deepfakes will remediate that very quickly.
Post reply on HN