South Park creators have new political satire series with AI-generated deepfakes
41–50 of 313 posts
Re: South Park creators have new political satire series with AI-generated deepfakes
#42This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
One thing that worries me is that everything is becoming immutable, saved forever, and digitally signed. Hard to claim you didn't post something if your account is super secure. You can't go anywhere without cameras taking your picture. And if someone steals your bitcoin or your smart contract has a mistake, your money is gone. You can't argue with an algorithm. And the internet never forgets. (Well, unless it is inconvenient for you, then Murphy's law applies ;-))
There are many such phenomena but I'd say they are all related: They mean you have less wiggle room for mistakes, or social deviance. If you are in a situation where you have to break a law, or if you are just having an affair, chances are someone or something is going to see you. There is no anonymity in the crowd anymore, on the contrary.
But this deep fake technology, if it really evolves to be undetectable, can be liberating, if it erodes the trust in pictures. At least the social control mechanisms based on cameras are going to stop working.
We were living in a very specific phase of human history, where we learned how to produce pictures from real scenes, but haven't learned yet to easily fake them. I just think this is going to come to an end, and we'll have to adapt. (I hope we'll adapt socially, and not just by cramming DRM into our technology like we tend do to; but that is a different topic.)
Re: South Park creators have new political satire series with AI-generated deepfakes
#43Deepfakes have the potential to turn the word upside down and cause utter chaos in the world. I don’t know how we are going to deal with it as a society, I think we are not equipped for it. In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason.
Re: South Park creators have new political satire series with AI-generated deepfakes
#44Deepfakes have the potential to turn the word upside down and cause utter chaos in the world. I don’t know how we are going to deal with it as a society, I think we are not equipped for it. In fact I fully expected trump to use it for the October surprise, but I guess he didn’t go there for whatever reason.
In the early days, you could spot one by the lack of blinking because the model was trained on open-eyed images. Not sure if that's still the case, I'd be surprised if it was. Any time I see a "this is peak technology" comment, I'm always reminded of the PC gaming magazine cover showing the first Unreal game's graphics ("Yes, that's an actual PC screenshot!"). It looks awful now, but in the nineties, it blew us all a…
Re: South Park creators have new political satire series with AI-generated deepfakes
#45I can imagine lifelike movies that render characters to the users preference in real-time.
Talk about “representation”!
I can imagine as well dialects, language, etc being rendered in real time to adapt to what the user prefers. You and another person could watch the same film and talk about the same story but have totally different experiences on what the characters looked like, talked like, and even said within some parameters.
Making a movie with humans will be a prestige event like riding horses today or driving an ICE in the future. They don’t be able to compete with rendered film at a mass scale due to cost. Rendered films could be built and distributed cheaply and cost a fraction of a real movie to watch.
Re: South Park creators have new political satire series with AI-generated deepfakes
#46This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
Audio and video evidence isn't admissible because it's audio or video (and may be inadmissible nonetheless). It's admissible because someone testifies under oath that they have personal knowledge of its provenance. The burden is on the party introducing the evidence to show that it's reliable, and the question of whether or not it is indeed reliable is a factual one for a judge or jury to answer. It's not assumed to be "true" or to accurately reflect reality just because it's a purported photo, video, or audio recording.
Re: South Park creators have new political satire series with AI-generated deepfakes
#47This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
But you can say "we have emails where he admits to doing this" in a court room, even though emails can be trivially faked. You just have to provide information about how you got the emails and how you know they're authentic. Is there a reason to expect video will be more problematic as it becomes easier to fake?
Re: South Park creators have new political satire series with AI-generated deepfakes
#48This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
Actually, I'm a bit more optimistic about this. One thing that worries me is that everything is becoming immutable, saved forever, and digitally signed. Hard to claim you didn't post something if your account is super secure. You can't go anywhere without cameras taking your picture. And if someone steals your bitcoin or your smart contract has a mistake, your money is gone. You can't argue with an algorithm. And the…
Re: South Park creators have new political satire series with AI-generated deepfakes
#49This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
Re: South Park creators have new political satire series with AI-generated deepfakes
#50This feels like the start of something very bad - they are going to be upfront about the deepfakes... others are not. It’s going to get to the point where you can’t even say in a court room “well we have video of him doing this”. The fact that deepfakes will exist will erode confidence in even those things that are true. At the same time it will add additional fake situations to the conversation. Worst part is that e…
You cannot underestimate the global political ramifications of this. If you think the amount of video manipulation was bad enough this cycle in the 2020 presidential election? Imagine a few years from now when video's are being put out by political operatives and people with nefarious agenda's with impunity all over social media.
This sort of thing absolutely terrifies me since you can start to twist reality to whatever you want and influence people in ways we never thought possible. I really feel like the genie is out of the bottle and this has the potential to become a very dangerous tool for people with bad intentions.