Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

11–20 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#11

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

Good question, maybe sign your videos with a key? Or perhaps another neural network to distinguish the real from the fake?

Yeah, the real reason Zoom should be actually be E2E encrypted.

Re: Avatarify lets users run realtime deepfakes on live video calls

#14
post #2

Voice fake has been done already as well. https://github.com/CorentinJ/Real-Time-Voice-Cloning

As someone whose tried this repo extensively with politican sound clips (I wanted to troll buddies on discord) - it kinds blows. Don't get me wrong - it's really neat but the results are far less good than one may expect.

Sometimes it almost works, and then it's just totally absurd. Long pauses, voices that don't sound compelling, total failures on female voices. It's great in theory but it showed me that there's a ton of work to be done with voice cloning.

Props to the author for using UMAP to seperates voices though

Also lol at the demand being so high that there are open issues of people offering to pay others to install this on their machine. Freelancing opportunities show up in the strangest of places...

Re: Avatarify lets users run realtime deepfakes on live video calls

#15

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

If I understood it correctly, deepfakes are relatively easy to detect by software if you know what you’re looking for. I can imagine video conferencing software can implement this, and display a warning in similar ways that phishing emails are currently handled.

Deepfakes are implemented with Generative Adverserial Networks (GANs), where one component is a discriminative network that is already trying to distinguish real from fake, to provide feedback to the generation.

So I think any detection algorithms would get into a never-ending arms race.

Re: Avatarify lets users run realtime deepfakes on live video calls

#16

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

Good question, maybe sign your videos with a key? Or perhaps another neural network to distinguish the real from the fake?

Isn't that already done? They're called generative adversarial networks...

Re: Avatarify lets users run realtime deepfakes on live video calls

#18

The way that the mouth and eyes move, but that the rest of the face is pretty static, is actually really charming to me. It betrays that it's a fake, which I think makes it easier to be a fun joke.

Reminds me of the chuckecheese robots

Re: Avatarify lets users run realtime deepfakes on live video calls

#19
Actual Github repo for this called Avatarify: https://github.com/alievk/avatarify

Original repo code that Avatarify is based on called First Order Model: https://github.com/AliaksandrSiarohin/first-order-model

Short video demonstrating First Order Model: https://www.youtube.com/watch?v=mUfJOQKdtAk

Re: Avatarify lets users run realtime deepfakes on live video calls

#20

The way that the mouth and eyes move, but that the rest of the face is pretty static, is actually really charming to me. It betrays that it's a fake, which I think makes it easier to be a fun joke.

That’s simple. If you are trying to fool someone....

“My internet speed is very low. I know the video is choppy”.

Post reply on HN