Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

South Park creators have new political satire series with AI-generated deepfakes

theregister.com

Post reply on HN
Print view View original

71–80 of 313 posts

Re: South Park creators have new political satire series with AI-generated deepfakes

#71

Post by m_ke »

at-fates-hands wrote: post #50
stanrivers wrote: post #11

This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…

> It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. You cannot underestimate the global political ramifications of this. If you think the amount of video manipulation was bad enough this c…

It's worse than that, politicians will be able to credibly claim that anything that's not advantageous to them is fake. We'll end up in a world where a tin pot dictator like Trump can go out and say that anything he said or did in the past was not real.

Re: South Park creators have new political satire series with AI-generated deepfakes

#72

Post by lagadu »

csmattryder wrote: post #16
yalogin wrote: post #4

Deepfakes have the potential to turn the word upside down and cause utter chaos in the world. I don’t know how we are going to deal with it as a society, I think we are not equipped for it. In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason.

In the early days, you could spot one by the lack of blinking because the model was trained on open-eyed images. Not sure if that's still the case, I'd be surprised if it was. Any time I see a "this is peak technology" comment, I'm always reminded of the PC gaming magazine cover showing the first Unreal game's graphics ("Yes, that's an actual PC screenshot!"). It looks awful now, but in the nineties, it blew us all a…

These do blink so it's no longer an issue. It's still not perfect because other than blinking the eyes have no expression to them, they're mostly still which is very unnerving once you start paying attention to that (it's also how you can tell a fake from a genuine smile). But we're at the point where unless you're looking for it, it's easy to believe.

Re: South Park creators have new political satire series with AI-generated deepfakes

#73

Post by diegoperini »

jimkleiber wrote: post #58
staticautomatic wrote: post #46

Earlier quoted context omitted.

I’ve said it here before and I’ll say it again: Audio and video evidence isn't admissible because it's audio or video (and may be inadmissible nonetheless). It's admissible because someone testifies under oath that they have personal knowledge of its provenance. The burden is on the party introducing the evidence to show that it's reliable, and the question of whether or not it is indeed reliable is a factual one for…

I appreciate you saying this, I hadn't known that. I think therefore it may be OK in the court of law but what about in the court of public opinion? I could see videos like this easily eroding our trust in the judicial system even further.

It's probably not gonna take a single generation to get used to this but as it always happened with new technology throughout centuries, people who are born into this new normal will know how not to be fooled.

Re: South Park creators have new political satire series with AI-generated deepfakes

#74

Post by autumn_unlaces »

stanrivers wrote: post #11

This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…

We'll know our disinformation program is complete when everything the American public believes is false.

Re: South Park creators have new political satire series with AI-generated deepfakes

#75

Post by grawprog »

standardUser wrote: post #61
grawprog wrote: post #55

I understand the worries behind deep fakes, but i'm going to be a bit facetious here, hasn't getting the most realistic, lifelike images always been the goal of computer graphics? Wouldn't deepfakes be the ultimate culmination of lifelike CGI. So lifelike it's indistinguishable from the real thing? Like for most of my life, this is the goal I keep hearing about. Now it's here, suddenly it's too real. I dunno just see…

I don't think anyone is disputing the idea that technology in this arena can/will/should advance, but rather that this specific set of technologies come with consequences that are, to many of us, absolutely terrifying. I also don't think we truly understood how susceptible so many people are to made up nonsense until recent years, so this particular kind of made up nonsense suddenly looks like a serious threat to soc…

>I also don't think we truly understood how susceptible so many people are to made up nonsense until recent years

That's not true, that's been the basis behind marketing and advertising since it existed. It's been fairly well known for a long time people easily believe nonsense.

Re: South Park creators have new political satire series with AI-generated deepfakes

#76

Post by germinalphrase »

diegoperini wrote: post #73
jimkleiber wrote: post #58

Earlier quoted context omitted.

I appreciate you saying this, I hadn't known that. I think therefore it may be OK in the court of law but what about in the court of public opinion? I could see videos like this easily eroding our trust in the judicial system even further.

It's probably not gonna take a single generation to get used to this but as it always happened with new technology throughout centuries, people who are born into this new normal will know how not to be fooled.

Will they be able to? Widespread cynicism and distrust feels more likely.

Re: South Park creators have new political satire series with AI-generated deepfakes

#77

Post by lkxijlewlf »

staticautomatic wrote: post #46
stanrivers wrote: post #11

This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…

I’ve said it here before and I’ll say it again: Audio and video evidence isn't admissible because it's audio or video (and may be inadmissible nonetheless). It's admissible because someone testifies under oath that they have personal knowledge of its provenance. The burden is on the party introducing the evidence to show that it's reliable, and the question of whether or not it is indeed reliable is a factual one for…

This works in a courtroom. This won't work for a politician who retweets a faked video that then incites real violence. And that, at least for now, is where we truly need to be concerned.

Re: South Park creators have new political satire series with AI-generated deepfakes

#78

Post by skocznymroczny »

nemo44x wrote: post #45

Dark days ahead for Hollywood. How long until Silicon Valley eats that industry? I can imagine lifelike movies that render characters to the users preference in real-time. Talk about “representation”! I can imagine as well dialects, language, etc being rendered in real time to adapt to what the user prefers. You and another person could watch the same film and talk about the same story but have totally different expe…

They would make their living by licensing the likeness of actors. Because you might have a great rendered movie, but most people will want a great rendered movie with Tom Cruise and Samuel L Jackson, not with nonane actors.

Re: South Park creators have new political satire series with AI-generated deepfakes

#79

Post by DennisP »

stanrivers wrote: post #11

This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…

So there are two problems: people not trusting true videos, and people trusting fake videos. I think the second problem is probably worse, and this satire will at least help with that.

Re: South Park creators have new political satire series with AI-generated deepfakes

#80

Post by Tenoke »

sandworm101 wrote: post #34
optymizer wrote: post #27

Earlier quoted context omitted.

I think it'll be similar to the situation with pictures. We've had the ability to 'photoshop' people's faces in and out of images for a long time now. I think the first question asked of a video is going to be "is this a deep fake?" just like we currently ask "is this picture photoshopped?". It doesn't mean that we no longer use pictures, or that we don't alter pictures, just that we are more critical of them. That s…

The issue is cost. Proving that an image is or isn't photoshopped isn't all that difficult/expensive. Anyone well versed in digital imagery can use basic tools to expose 99.99% of photoshopped images. But moving pictures are different. Due to compression artifacts and the overall lower quality of each frame there is much more room for opinion. An answer one way or another may be possible but it will be a much greater…

If anything it's the opposite and it's much harder to fake videos without leaving traces.
Post reply on HN