Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

Post reply on HN
Print view View original

121–127 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#121

Post by cheez »

luhem7 wrote: post #113
cheez wrote: post #91

Earlier quoted context omitted.

A main premise of the Fear the Sky trilogy as well but solved a different way. Machines representing various political factions from the home planet are uploaded with AI that mimics them emotionally and politically for all intents and purposes. I really enjoyed this book.

Eh, I personally enjoyed the series, but I wouldn't recommend anything beyond book 1. Book 2 is ok. Book 3 really spoiled the series for me because of the inconsistent behavior if the main character. (Keeping it vague to avoid spoilers)

Same. Notice I said "the book" while mentioning the trilogy ;-)

Re: Avatarify lets users run realtime deepfakes on live video calls

#122

Post by Scoundreller »

JadeNB wrote: post #69
4lun wrote: post #58

Earlier quoted context omitted.

> I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really underestimate how important high definition is for human communication. Low latency is probably more important to me. Recently I seem to have a 3 second delay on many VC calls at work (and just for me it seems), and I either end up interrupt…

> Despite that I get a crystal clear HD picture for all participants, but I'd happily sacrifice video quality (in fact I'd accept audio only in some cases) to get a more real time experience (disabling video doesn't seem to have any effect). If you're really willing to sacrifice video completely, at least for Zoom, and probably for lots of other videoconferencing solutions, you can call into meetings with your phone.…

Yes, zoom supports that.

Slight issue in Toronto has been cellular system overloading and calls not being completed. But once on, no problem.

I can’t blame the providers though. How could they have predicted that people would use the service they’re paying for?

Re: Avatarify lets users run realtime deepfakes on live video calls

#123

Post by ajflores1604 »

JimDabell wrote: post #37

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

This is very loosely what nvidias dlss game upscaling does. Generalized NN trained on super high resolution game engine output. You can run a game at like a quarter to half resolution and it upscales the rest.

https://www.nvidia.com/en-us/geforce/news/nvidia-dlss-2-0-a-...

Re: Avatarify lets users run realtime deepfakes on live video calls

#124

Post by mlonkibjuyhv »

4lun wrote: post #58
lambdaba wrote: post #39

Earlier quoted context omitted.

Excellent idea and we'll surely be seeing something like this, there are AR apps that already map facial expressions to avatars. Downside could be some uncanny valley if the models are not very high quality. But if I had to make a prediction, I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really…

> I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really underestimate how important high definition is for human communication. Low latency is probably more important to me. Recently I seem to have a 3 second delay on many VC calls at work (and just for me it seems), and I either end up interrupt…

This is a long shot - but are you running on battery while this is happening? Had some weird issues that worked themselves out by plugging in the charger. Probably had to do with power savings and cpu throttling.

Re: Avatarify lets users run realtime deepfakes on live video calls

#125

Post by Der_Einzige »

abledon wrote: post #115
Der_Einzige wrote: post #14

Earlier quoted context omitted.

As someone whose tried this repo extensively with politican sound clips (I wanted to troll buddies on discord) - it kinds blows. Don't get me wrong - it's really neat but the results are far less good than one may expect. Sometimes it almost works, and then it's just totally absurd. Long pauses, voices that don't sound compelling, total failures on female voices. It's great in theory but it showed me that there's a t…

could you post some examples with dropbox of the 'less than stellar' results you were getting?

Find audio clips of trump speaking Try running then through this

See what you get.

To be fair, I was trying this repo almost a 6 months ago so updates may have improved it.

Re: Avatarify lets users run realtime deepfakes on live video calls

#126

Post by PeterisP »

bloopernova wrote: post #67
blackdogie wrote: post #4

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

My opinion on this is that we will "soon" have "trusted" webcams that create some sort of signature in each frame. In other words, a way to say "this is what the camera saw, guaranteed". Probably something that would be built into phones and laptops first. Of course, we know that messing with such a datastream would be easy for us, but for enterprise users (think liability) and news organizations it could be a real b…

Technically it would not be "this is what the camera saw, guaranteed" but "this is what the possessor of some signing key asserts they saw".

If a single shoddy manufacturer of cheap webcams somehow leaks a key that should have been on that webcam, then any software can easily encode a video stream with signatures asserting "this is what the camera saw, guaranteed".

Re: Avatarify lets users run realtime deepfakes on live video calls

#127

Post by PeterisP »

postingawayonhn wrote: post #51
ravenstine wrote: post #48

I seriously wonder how this will affect online dating. Not that I've dated in quite a few years, but even if I wanted to, I wouldn't go back because last time I did, the proliferation of obnoxious Instagram filters and photoshopping made the experience unenjoyable. Fake people aren't appealing. I would bet that the ease at which the average person can deep fake will only make matters much worse. There will always be…

Why do you think people would use fake pictures on mass. If they wanted to create a profile with pictures that aren't themselves then surely it's easier to just steal someone else's?

It's easier to automatically detect in large scale if you're reusing someone else's pictures, so for some social media sites this will immediately flag you as a potential fake profile and escalate to requirements to e.g. use a mobile phone number verification, etc.
Post reply on HN