Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

21–30 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#22
post #2

Voice fake has been done already as well. https://github.com/CorentinJ/Real-Time-Voice-Cloning

As someone whose tried this repo extensively with politican sound clips (I wanted to troll buddies on discord) - it kinds blows. Don't get me wrong - it's really neat but the results are far less good than one may expect. Sometimes it almost works, and then it's just totally absurd. Long pauses, voices that don't sound compelling, total failures on female voices. It's great in theory but it showed me that there's a t…

Real Time Voice Cloning certainly has iffy output, but it's probably the most popular because it provides the easiest plug-and-play experience with even a simple UI to get started.

The author says he's working on a more polished toolkit called Resemble.AI, but I've never tried it. https://www.resemble.ai/

There's certainly a market out there for just beautifying existing repos to making it easier for non-scholars to get going. Even having a Colab Notebook ready to click-and-start is quite powerful -- probably a big reason why First Order Model (source paper to the original story) got so much traction so quickly.

Re: Avatarify lets users run realtime deepfakes on live video calls

#23

This is pretty funny. I wonder, how hard would it be to use tech like this to make it look like you are looking the camera “in the eyes”?

Apple is doing this on FaceTime with the latest iOS. Pretty neat feature, makes Video calls more personal.

Re: Avatarify lets users run realtime deepfakes on live video calls

#24

This is pretty funny. I wonder, how hard would it be to use tech like this to make it look like you are looking the camera “in the eyes”?

Apple is doing this on FaceTime with the latest iOS. Pretty neat feature, makes Video calls more personal.

You're right, I didn't know about that. Thanks!

Link: https://9to5mac.com/2019/07/03/facetime-eye-contact-correcti...

Re: Avatarify lets users run realtime deepfakes on live video calls

#25
post #10

All the new mobile banks seem to do their ID verification/KYC using video selfies. Interesting to consider whether deepfakes are being used in wild to fool these systems and commit fraud.

They try to mitigate this. They ask you for example to move your hands around your face and bend your ID card.

Re: Avatarify lets users run realtime deepfakes on live video calls

#26
At first I thought it was someone with TDS that could bring up Trump in a completely unrelated article ("Russians saying things to get him elected") but then I looked up and the author is a Pakistanti lady (see the tribune article). I guess this is Pak interference then?

Re: Avatarify lets users run realtime deepfakes on live video calls

#27

Couldn't I just wear an N-95 mask? Once the pandemic is over, I'm never using Zoom again anyway.

You’re never working remotely or do you plan to use a different app/service?

And good news... this works with other services, not just Zoom.

Re: Avatarify lets users run realtime deepfakes on live video calls

#29
post #11

Earlier quoted context omitted.

Good question, maybe sign your videos with a key? Or perhaps another neural network to distinguish the real from the fake?

Yeah, the real reason Zoom should be actually be E2E encrypted.

Authenticity is about signing more than encrypting. But having that actually work would require a robust key distribution system that's actually usable by the general public.

Re: Avatarify lets users run realtime deepfakes on live video calls

#30
Sounds like it would be with a few minutes of fun on a daily status call during these work-from-home days of quarantine. For the time being the goofiest it’s gotten was someone using a virtual webcam that allowed for green-screen and looping video of the Max Headroom background... Which reminds me, though slightly off topic, if there’s virtual webcam software whose sole point is to keep a log of all of the applications using the built-in camera or mic. That might be useful.
Post reply on HN