Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

South Park creators have new political satire series with AI-generated deepfakes

theregister.com

Post reply on HN
Print view View original

151–160 of 313 posts

Re: South Park creators have new political satire series with AI-generated deepfakes

#151

Post by prutschman »

sega_sai wrote: post #82

Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?

So I can cryptographically prove that at a particular date at a particular time with a particular camera that I authentically pointed my camera at a screen projecting faked content?

I think this only works if you're signing something currently much harder to fake, like a full light-field or something, and even then it won't stay hard to fake forever.

Re: South Park creators have new political satire series with AI-generated deepfakes

#152

Post by ethbr0 »

AnthonyMouse wrote: post #100
lkxijlewlf wrote: post #77

Earlier quoted context omitted.

This works in a courtroom. This won't work for a politician who retweets a faked video that then incites real violence. And that , at least for now, is where we truly need to be concerned.

> This works in a courtroom. Does it though? Suppose there is a theft at a company. The police go to the company's security team and get the surveillance footage. Presumably admissible. If it was an inside job, the surveillance footage could be a deepfake showing someone else committing the crime. Or maybe it's real surveillance footage. Without some way to distinguish the two, how do you know?

The interaction of our current legal system with SotA deepfakes seems terrifying.

To rip from current headlines: https://www.justice.gov/usao-wdpa/pr/erie-man-charged-arson-...

(Leaving aside the merits of the case / opinions, and just using it as an example)

".. the [Facebook Live & coffee shop] videos depict a male – with distinctive hair to the middle of his back wearing a white mask, white shirt, light blue jean jacket, black pants with a red and white striped pattern down the side and red shoes - setting a fire inside of Ember + Forge."

"A review of additional Facebook public video footage from the area of State Street near City Hall in Erie on the evening of May 30, 2020, shows the same individual without the mask but wearing identical clothing and shoes. The subject’s face is fully visible in this video footage."

And that's a federal arson charge (min 5 years, max 20 years prison).

Re: South Park creators have new political satire series with AI-generated deepfakes

#153

Post by intotheabyss »

ethbr0 wrote: post #149
chrisseaton wrote: post #132

Earlier quoted context omitted.

But at least there is a human being behind each statement. You can question, you can examine their motives, you can challenge. A video is just a video. An anonymous accuser. You can't ask a video any questions.

Slightly OT, but I finally realized this was probably the long-game behind Facebook et al.'s real-identity-only policy. Sure it has the side (main!) benefit of empowering targeted advertising. But fundamentally creating traceability between content/comment and a singular identity enables elimination of the most egregious abuses (mass-disinformation/ganging). I'm as 90s internet-is-for-anonymous as anyone, but I have…

We can create decentralized identity systems, where you decide which information should be public, while also providing accountability.

https://www.microsoft.com/en/security/business/identity/own-...

Rather than let mega corps control identities, which should be building open source tools to allow developers to include decentralized identities within their platforms, preferably systems that interoperate with Ethereum.

Re: South Park creators have new political satire series with AI-generated deepfakes

#154

Post by rossjudson »

hospadar wrote: post #57

This is SO GREAT! I often feel deep existential dread about deepfakes and the lag between when they are viable (now) and when everyone stops trusting video that doesn't have some kind of rock-solid signed/encrypted/testified provenance (years from now or never?). What better way to educate the public about deepfake technology than with over-the top satire?

I couldn't agree with you more. It probably is the best way to popularize what deep fakes can really do.

I also agree on video provenance/signing. Perhaps signed video will be something devices do by default in the future. If there are multiple devices recording, we can probably find a way to cross-check. Actually, that probably also exists. ;)

Re: South Park creators have new political satire series with AI-generated deepfakes

#155

Post by kube-system »

Apes wrote: post #146
AnIdiotOnTheNet wrote: post #122

Earlier quoted context omitted.

Sadly we are well aware of how inaccurate and untrustworthy eye-witness accounts can be.

As inaccurate and untrustworthy as deepfakes are making video?

If not worse.

1. Physical evidence can at least by analyzed by a third party, and

2. Misleading deepfakes aren't created accidentally by honest people.

Re: South Park creators have new political satire series with AI-generated deepfakes

#156

Post by pessimizer »

whatnojeez wrote: post #19
yalogin wrote: post #4

Deepfakes have the potential to turn the word upside down and cause utter chaos in the world. I don’t know how we are going to deal with it as a society, I think we are not equipped for it. In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason.

> In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason. Because he's not the cartoon supervillain you think he is?

He has to be a supervillain, or else how could he have defeated the perfect team that ran the perfect campaign for the perfect candidate in 2016?

Re: South Park creators have new political satire series with AI-generated deepfakes

#157

Post by alcover »

keiferski wrote: post #112
scarmig wrote: post #107

Earlier quoted context omitted.

Where the ultimate onus of responsibility falls doesn't matter much when you've got a bunch of Rohingya hanging from trees because some politician retweeted a fake video.

If you follow it through, that line of argument makes no sense. If the video weren't fake, would that somehow make the murder of Rohingya acceptable? Of course not. Ultimately you end up back at the beginning: holding people, and not pieces of information, accountable for their actions. That's an issue with civil society, not social media.

  If the video weren't fake, would that somehow make the murder of Rohingya acceptable?
Your answer is astray. What is at stake is evident : one can now provoke riots and deaths from thin air (and bits).

Re: South Park creators have new political satire series with AI-generated deepfakes

#158

Post by pjc50 »

ethbr0 wrote: post #149
chrisseaton wrote: post #132

Earlier quoted context omitted.

But at least there is a human being behind each statement. You can question, you can examine their motives, you can challenge. A video is just a video. An anonymous accuser. You can't ask a video any questions.

Slightly OT, but I finally realized this was probably the long-game behind Facebook et al.'s real-identity-only policy. Sure it has the side (main!) benefit of empowering targeted advertising. But fundamentally creating traceability between content/comment and a singular identity enables elimination of the most egregious abuses (mass-disinformation/ganging). I'm as 90s internet-is-for-anonymous as anyone, but I have…

Much of the worst content is published by people under their own names and news bylines. And then happily retweeted by people under their own names.

It gets worse when businesses and adverts are included in the mix. Who is Bob's News Agency, really? Can you click on every advert to find who paid for it? No.

Re: South Park creators have new political satire series with AI-generated deepfakes

#159

Post by alcover »

cm2187 wrote: post #110
wcarron wrote: post #108

Earlier quoted context omitted.

What? There are obvious examples where faked video can have a serious affect. What kind of solipsistic nightmare are we slipping into?

Because people still have some faith in videos. Deepfakes will remediate that very quickly.

I fear they won't. Some crowds only need a spark to explode. They won't wait for counter-evidence. They just need a pretext.

Re: South Park creators have new political satire series with AI-generated deepfakes

#160

Post by will4274 »

Pxtl wrote: post #69

Let's remember their politics, though - they used to market themselves as "both sides are bad" indpendants/libertarians, but now they're full-out Trumpers. I could see clips from this show making the rounds on lower-information parts of social media like Facebook that are already prone to being hoodwinked by conservative fake news like Alex Jones and the like. Professionally-produced deepfakes becoming the exact atta…

Should be a headline from The Onion - Famous satirist uses 'satire' in public; crowd (including Pxtl) unaware; takes him literally.
Post reply on HN