Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

South Park creators have new political satire series with AI-generated deepfakes

theregister.com

Post reply on HN
Print view View original

131–140 of 313 posts

Re: South Park creators have new political satire series with AI-generated deepfakes

#131

Post by utexaspunk »

skocznymroczny wrote: post #78
nemo44x wrote: post #45

Dark days ahead for Hollywood. How long until Silicon Valley eats that industry? I can imagine lifelike movies that render characters to the users preference in real-time. Talk about “representation”! I can imagine as well dialects, language, etc being rendered in real time to adapt to what the user prefers. You and another person could watch the same film and talk about the same story but have totally different expe…

They would make their living by licensing the likeness of actors. Because you might have a great rendered movie, but most people will want a great rendered movie with Tom Cruise and Samuel L Jackson, not with nonane actors.

Until you make a completely artificial persona that gets famous.

Re: South Park creators have new political satire series with AI-generated deepfakes

#132

Post by chrisseaton »

AnIdiotOnTheNet wrote: post #122
chrisseaton wrote: post #116

Earlier quoted context omitted.

> I often feel deep existential dread about deepfakes and the lag between when they are viable (now) and when everyone stops trusting video that doesn't have some kind of rock-solid signed/encrypted/testified provenance (years from now or never?). Maybe we'll have to go back to sworn witness statements. Worked for thousands of years.

Sadly we are well aware of how inaccurate and untrustworthy eye-witness accounts can be.

But at least there is a human being behind each statement. You can question, you can examine their motives, you can challenge. A video is just a video. An anonymous accuser. You can't ask a video any questions.

Re: South Park creators have new political satire series with AI-generated deepfakes

#133

Post by iso1210 »

staticautomatic wrote: post #102
mrfox321 wrote: post #91

Earlier quoted context omitted.

But the jury are humans. Should we be confident that a jury of 12 (if in US) can pretend that really convincing deepfakes should not be trusted? Especially when this form of evidence has been trustworthy for a decent chunk of time?

If no one can testify about the video’s provenance, then it simply won’t be admitted into evidence. If someone commits perjury in order to get the video admitted, the jurors will be the least of the problems.

People commit perjury all the time

Re: South Park creators have new political satire series with AI-generated deepfakes

#134

Post by filleokus »

ip26 wrote: post #126
filleokus wrote: post #118

Earlier quoted context omitted.

Expect from editing, which, as you say should be able to be solved somehow (encrypt every frame?), I think the biggest problem is the equivalent of the "analog hole". How do you know if a signed recording is from the actual event, or from a camera being pointed at a screen in a pitch black room recording the playback of some malicious video trying to show said event?

Trust. If the root signatory is CNN, you decide whether you trust CNN not to do that. Not really any different from other encryption. Your bank could be defrauding you on the back end despite the verified https session. But you trust they aren't.

Why do we need to sign the video then? Isn't it enough for me to ensure that I have a secure TLS connection to https://cnn.com? Maybe for external platforms? But then the challenge is just proving that https://www.youtube.com/user/CNN/ is controlled by CNN. Much simpler than involving the cameras.

Re: South Park creators have new political satire series with AI-generated deepfakes

#135

Post by pengaru »

juskrey wrote: post #81
pengaru wrote: post #66

Earlier quoted context omitted.

While I agree on your first point, the rest completely misses that the public will continue to be tribal and instead only believe the talking heads of their given tribe as authentic in a world rife with deep fakes. I fully expect the outcome to be increased tribalism, when faith in your tribe's leadership and information sources is the only source of comfort, confidence, and "truth". I don't think it will be the oppo…

Local talking heads by definition can be punched into the face, seen in the local coffeeshop etc. They have skin in the game. Presidents don't.

What does that have to do with deep fakes pushing consumers of Fox News talking heads further into the arms of Fox News?

Are you imagining if Tucker Carlson were punched in the face at his local coffee shop, he'd shut up? :rolleyes: His following would only grow larger and more supportive as he milked the controversy for all its worth.

Re: South Park creators have new political satire series with AI-generated deepfakes

#136

Post by iso1210 »

sega_sai wrote: post #82

Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?

There's the Trusted News Initiative [0] and Project Origin [1,2]. Too little, and not enough support imo.

[0] https://www.bbc.co.uk/mediacentre/latestnews/2020/trusted-ne...

[1] https://www.bbc.co.uk/blogs/aboutthebbc/entries/46f5eb33-b7b...

[2] https://www.originproject.info/

Re: South Park creators have new political satire series with AI-generated deepfakes

#138

Post by Cthulhu_ »

blonde_ocean wrote: post #99
sega_sai wrote: post #82

Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?

The toughest issue here, IMO, is being able to sign and authenticate a document without proprietary DRM. Been thinking about this a lot.

DRM is indeed what it is; you need to verify a signature somewhere to ensure it hasn't been tampered or altered, which requires an internet connection to verify or download.

Re: South Park creators have new political satire series with AI-generated deepfakes

#139

Post by InitialLastName »

dchichkov wrote: post #60
grawprog wrote: post #55

I understand the worries behind deep fakes, but i'm going to be a bit facetious here, hasn't getting the most realistic, lifelike images always been the goal of computer graphics? Wouldn't deepfakes be the ultimate culmination of lifelike CGI. So lifelike it's indistinguishable from the real thing? Like for most of my life, this is the goal I keep hearing about. Now it's here, suddenly it's too real. I dunno just see…

Who knows, maybe out of that more attention will be paid to a message, rather than the person. Cults of personality had always been problematic. And, technically, this allows to grab the personality and dissolve the cult.

The problem is that, in a representative democracy, voters are deciding on the person, rather than the message. If you have systems that increase the noise floor in the link between the two, you end up with an electorate that's less well-equipped to make coherent decisions.

Re: South Park creators have new political satire series with AI-generated deepfakes

#140

Post by iso1210 »

tsomctl wrote: post #54
yalogin wrote: post #4

Deepfakes have the potential to turn the word upside down and cause utter chaos in the world. I don’t know how we are going to deal with it as a society, I think we are not equipped for it. In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason.

Create short deepfakes that can go viral and be so ridiculous that they're both entertaining and obviously fake. Obama advocating for a border wall. Al Gore lobbying for the oil industry. Steve Jobs advising against staring at a screen all day.

> Obama advocating for a border wall

Would be used as evidence of how untrustworthy the Dems are.

This video of two opponents endorsing each other cropped up last year.

https://www.bbc.co.uk/news/av/technology-50381728

Post reply on HN