301–310 of 313 posts
People are going crazy over deepfakes but we've had Photoshop for a long time and the world hasn't ended. We find ways to verify the content of photos through other means, such as their provenance.
I think the biggest casualty of deepfakes are going to be citizens. Record a video of police brutality or crime footage and it can all be shrugged off as a deep fake. TV stations and journalists can afford 'signed videos'.
I could easily see a deep fake viral video go around in a sub-Saharan country, with a leader claiming he is gay or something else socially unforgivable in that country, and starting an internal ethnic conflict that cannot be undone.
People are going crazy over deepfakes but we've had Photoshop for a long time and the world hasn't ended. We find ways to verify the content of photos through other means, such as their provenance.
Verifiable content is definitely not the norm through history. I’d love to see an academic analysis of whether misinformation really went down by much (if at all) when photography became a thing. Or when camera phones and social media came along. Yesterday there was a fake Trump tweet with a zillion upvotes on Reddit, and that’s just text. Text is trivial to fake, so maybe the chain of trust we see in text is what we…
Earlier quoted context omitted.
I agree 100%. Deepfake hysteria is absurd. I'm the author of https://vo.codes , and my goal has been to make deep fakes as accessible as possible so people become familiar with them. You know what people use vo.codes for? Memes. That's it. A number of journalists have decided the technology is entirely confusing and deceitful. While there are new risks posed by deep fakes, I believe the potential for good far outweig…
The problem I'm most afraid of isn't people actually using deepfakes for nefarious purposes (although I think you are not nearly concerned enough about that... It would be very easy for Russia or China to alter local elections by making a grainy video of a candidate appearing to smoke crack a la Rob Ford, for example). I'm afraid of people internalizing the idea that you can't trust video at all. I agree with your cr…
It can be used to destabilize small countries rapidly to provoke a ethnic or religious conflict. In conjunction with other tactics and a prepared military effort.
Imagine if ISIS did this to Assad just before their main offensive? Or if Hezbollah did it to the Prime Minister or Lebanon before a renewed military offensive? Or if China did it to the mayor of Hong Kong just before sending in troops.
It has a lot of potential when used together with other tactics.
Earlier quoted context omitted.
Blurring around the face edges and mismatched lighting still give them away. Time will tell if the machines can overcome a trained eye.
I think that is a bit of selection bias. Outside of what I've seen in papers Ctrl Click Face[0] has some of the best "in practice" deep fakes I've seen. The video in the main post is meant to be a joke. But these still aren't state of the art and really are just "some dude" that is doing this on their own. Not a production studio. What I think is different here is that we can think that: photoshop got so good that yo…
From the NY Times article:
> The “Sassy Justice” creators said they had spent “millions” of dollars to make the video, including the initial investments to produce the halted movie and set up the Deep Voodoo studio, though they declined to specify the exact cost. “It’s probably the single most expensive YouTube video ever made,” Parker said.
Earlier quoted context omitted.
Who knows, maybe out of that more attention will be paid to a message, rather than the person. Cults of personality had always been problematic. And, technically, this allows to grab the personality and dissolve the cult.
The problem is that, in a representative democracy, voters are deciding on the person, rather than the message. If you have systems that increase the noise floor in the link between the two, you end up with an electorate that's less well-equipped to make coherent decisions.
It'd be likely better, if that decision is made based on character - the pattern of thoughts of the person, rather than the charisma - attractiveness or charm.
If it is possible to curb charisma/charm/cults of personality with realistic fakes, overall the effect might be advantageous.
Earlier quoted context omitted.
You could have the camera record the lidar also and crypto sign that too. Assuming it is all done in camera and the lidar is high resolution enough it should be possible to completely tamper proof a video recording at least at the “talking head” level. I think Apple could possibly start providing this for iPhone videos if they decided to as the hardware is all there already both the lidar sensor as well as the Secure…
I think this idea of adding additional layers is on the right track because it confounds the deepfake generation problem by adding a curse of dimensionality. You can't just fake 2D. You need to fake 3D which is much harder. I'm curious what the equivalent of "3D" to "2D" will be for deepfaked voice would be.
Is there some kind of private/public key signing technique for videos, when the camera creating a video signs it with some key providing a signature that can be verified for authenticity ? so you would be able to at least verify that the video was created at certain date on a certain camera ?
I've done some thinking about how to prove that a video was filmed at a particular time. I've written parts of the design but haven't written any code yet. The idea is to have a group of public Internet servers that create a hash chain mesh. Every second, each server produces a new block, containing the SHA3-512 hash (digest) of the previous block, hashes of many other servers' previous block, and hashes of user docu…
Earlier quoted context omitted.
I think that is a bit of selection bias. Outside of what I've seen in papers Ctrl Click Face[0] has some of the best "in practice" deep fakes I've seen. The video in the main post is meant to be a joke. But these still aren't state of the art and really are just "some dude" that is doing this on their own. Not a production studio. What I think is different here is that we can think that: photoshop got so good that yo…
Small correction, but the video in the main post was indeed created by a production studio of deep fake artists. From the NY Times article: > The “Sassy Justice” creators said they had spent “millions” of dollars to make the video, including the initial investments to produce the halted movie and set up the Deep Voodoo studio, though they declined to specify the exact cost. “It’s probably the single most expensive Yo…
Earlier quoted context omitted.
I've done some thinking about how to prove that a video was filmed at a particular time. I've written parts of the design but haven't written any code yet. The idea is to have a group of public Internet servers that create a hash chain mesh. Every second, each server produces a new block, containing the SHA3-512 hash (digest) of the previous block, hashes of many other servers' previous block, and hashes of user docu…
Such a system exists, it’s called OpenTimestamps
https://petertodd.org/2016/opentimestamps-announcement#how-o...