Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deep Live Cam: Real-time face swapping and one-click video deepfake tool

deeplive.cam

Post reply on HN
Print view View original

131–140 of 179 posts

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#131

Post by instagraham »

KolmogorovComp wrote: post #16
rnimmer wrote: post #6

FTA: "Ethical Use Safeguards Built-in checks prevent processing of inappropriate content, ensuring legal and ethical use." I see it claims to not process content with nudity, but all of the examples on the website demo impersonation of famous people, including at least one politician (JD Vance). I'm struggling to understand what the authors consider 'ethical' deepfaking? What is the intended 'ethical' use case here?…

For many (notably mastercard and VISA), when they say “ethical” they really mean anything but porn.

That they do, but perhaps the relevant context is that while porn is globally unregulatable, but the one entity that has proven its ability to regulate it (or at least exercise some control over it) have been payment processors like Visa and Mastercard.

FT had a fantastic podcast on the porn industry and the guy behind Mindgeek. Like many stories about multinational entities, you constantly hear the usual refrains - noone can regulate this, the entities keep changing their name and face, there is no accountability, etc. But when Visa and Mastercard threaten to pull their payments, the companies have to listen.

Visa and mastercard are the de facto regulators of porn today, and mostly do so to prevent nonconsentual and extreme fetish stuff from being displayed on mainstream platform.

From what I gathered from the podcast, they're not super keen on being the regulator - but it's a dirty job and somebody has to do it.

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#134

Post by kshri24 »

I am not at all comfortable with this. Even though it is an amazing demo I feel the release of this tool could not have been more ill-timed. It has all the potential of wrecking US elections this year. I don't really know what the optimal release time should have been but I don't see how this can be used for good at all. And I am still just considering implications of this restricted to elections. I am not even going to think about what it would mean to child porn, terrorism and even entire assassinations orchestrated to destabilize a Government leading to Civil/World Wars. Lots of things can go wrong with this tech.

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#135

Post by mhuffman »

realce wrote: post #126
rebeccaskinner wrote: post #121

Earlier quoted context omitted.

Just a few off the top of my head: Movies and TV: - As an alternative to motion capture for animation - As an alternative to existing de-aging CGI when you want to flash back to a younger version of a character (especially for cases where newer sequels are being made for much older movies) - As an easy way to get some additional footage if an actor no longer looks the part In a professional setting: - Conduct job int…

None of these uses - most of which benefit a slim percentage of society or are needlessly complicated by this technology - outweigh the severe downsides to society. It's the apex of foolishness to act glibly about this. This all ends extremely badly.

The counterpoint is that some or all of these could make money and not enough people care how it ends if money is being made. I suspect it will have to take a terrorist plot using generative AI or something similarly significant to shut the door and even then it will be disallowed by us commoners, not the big four or five AI companies and not to the rest of the world.

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#136

Post by mhuffman »

BugsJustFindMe wrote: post #13
dpweb wrote: post #9

Facinating software although I hope the idea "we're gonna rely on people to be good humans and DO THE RIGHT THING" is quickly abandoned and instead there is just as robust development of detection software that goes along with newer and better deep fake tools.

Detection is ultimately impossible. Anything you can detect can be explicitly evaded.

I think the terminal solution to this, in the US and maybe the EU, will be putting identifying code/chips into all devices capable of connecting to the Internet that will tag all content (video, text, audio, images) in some way where browsers will have to legally change to interpret them. This will make everyone either unable to use the Internet or known to anyone that "needs to know".

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#137

Post by godelski »

KolmogorovComp wrote: post #16
rnimmer wrote: post #6

FTA: "Ethical Use Safeguards Built-in checks prevent processing of inappropriate content, ensuring legal and ethical use." I see it claims to not process content with nudity, but all of the examples on the website demo impersonation of famous people, including at least one politician (JD Vance). I'm struggling to understand what the authors consider 'ethical' deepfaking? What is the intended 'ethical' use case here?…

For many (notably mastercard and VISA), when they say “ethical” they really mean anything but porn.

So....

  ffmpeg -i porn.mp4 -vf "crop=crop_w:crop_h:coord_x:coord_y" "definitely not porn.mp4"
  *faceswap "definitely not porn.mp4*
  ffmpeg -i porn.mp4 -i "swapped definitely not porn.mp4" -filter_complex "[0][1]overlay=coord_x:coord_y" -c:a copy "deepfake porn.mp4"
Got it

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#138

Post by mc32 »

kshri24 wrote: post #134

I am not at all comfortable with this. Even though it is an amazing demo I feel the release of this tool could not have been more ill-timed. It has all the potential of wrecking US elections this year. I don't really know what the optimal release time should have been but I don't see how this can be used for good at all. And I am still just considering implications of this restricted to elections. I am not even going…

Another huge issue is fraud. People impersonating others for financial fraud, etc.

Question is, is it stoppable? Doubt anyone thinks it can be stopped unless you get into fascistic/communistic/authoritarian tactics of arresting people for just using it at all.

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#139

Post by godelski »

tdeck wrote: post #68
rnimmer wrote: post #6

FTA: "Ethical Use Safeguards Built-in checks prevent processing of inappropriate content, ensuring legal and ethical use." I see it claims to not process content with nudity, but all of the examples on the website demo impersonation of famous people, including at least one politician (JD Vance). I'm struggling to understand what the authors consider 'ethical' deepfaking? What is the intended 'ethical' use case here?…

The answer is that anyone working on deepfakes doean't care much about ethics or they wouldn't be doing it in the first place.

I think this is an oversimplification that undermines your goals.

If you're unwilling to recognize the benefits of something, it becomes easier to dismiss your argument. Instead, the truth is balancing trade-offs and benefits. Certainly there is a clear and harmful downside to this tech. But there are benefits. It does save a lot of money for the entertainment industry when you need to edit or do retakes. The most famous example might be superman[0].

The issue is that when the downsides get easy to dismiss, it becomes easy to get lost in the upsides. It'll get worse because few people consider themselves unethical. We're all engineers and we all have fallen for this trap in some way or another. But we also need to remember that the road to hell isn't paved with malicious intent...

[0] https://www.youtube.com/watch?v=2nxanN85O84

Re: Deep Live Cam: Real-time face swapping and one-click video deepfake tool

#140

Post by cdrini »

It's really getting to the point where multimedia online shouldn't be trusted unless it's from a reputable source and cross verified.

I wonder, is there a universe where maybe cameras are updated to add some sort of digital signature to videos/photos to indicate they are real and haven't been tampered with? Is that feasible/possible? I'm not skilled with cryptography stuff to know, but if we can digital sign documents with some amount of faith...

I've heard folks mention trying to tag AI photos/videos, but it seems like tagging non-AI photos/videos is more feasible?

Post reply on HN