Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

61–70 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#61
post #57

Ok so how about an app that does the opposite of this, and can prove that the video/audio data hasn't been tampered with since it was created? I don't think it would need much more than public/private key encryption, and a blockchain ledger to record every-time the data was transmitted from one user to another. Thoughts?

[deleted]

Re: Avatarify lets users run realtime deepfakes on live video calls

#62
post #57

Ok so how about an app that does the opposite of this, and can prove that the video/audio data hasn't been tampered with since it was created? I don't think it would need much more than public/private key encryption, and a blockchain ledger to record every-time the data was transmitted from one user to another. Thoughts?

How would you prevent against a deepfake program presenting itself as a camera? From your applications perspective, it's raw data directly from the camera but there's no guarantee the camera is just a camera.

Re: Avatarify lets users run realtime deepfakes on live video calls

#63

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

This is a minor plot point in Vernor Vinge's excellent SF novel A Fire Upon the Deep.

One of the premises of the novel's universe is that computational power is generally absurdly plentiful, but communications bandwidth over interstellar distances is not. Most communications are in plain text (modeled after USENET) but in some cases, "evocations" are used to extrapolate video and audio from an ultra-compressed data stream.

The trouble, of course, is that it's not very obvious what aspects of the image you're seeing are real, and what aspects were dreamed up by the system doing the extrapolating.

Re: Avatarify lets users run realtime deepfakes on live video calls

#64

Hey guys! I'm one of the founders of Impressions, the first mobile deepfake app on a phone. Try it out and give us your thoughts. Right now it's out for IOS but Android is on route. Here's our website https://impressions.app

Very weak output I’ve seen so far. Trying another before passing judgment, but honestly this is so obviously fake output so far.

Edit: now done three images, all well lit face, no dramatic movements, and the output is just terrible.

Re: Avatarify lets users run realtime deepfakes on live video calls

#65

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

This is a minor plot point in Vernor Vinge's excellent SF novel A Fire Upon the Deep . One of the premises of the novel's universe is that computational power is generally absurdly plentiful, but communications bandwidth over interstellar distances is not. Most communications are in plain text (modeled after USENET) but in some cases, "evocations" are used to extrapolate video and audio from an ultra-compressed data…

> it's not very obvious what aspects of the image you're seeing are real, and what aspects were dreamed up by the system doing the extrapolating.

It would be quite obvious unless the raw data before extrapolating is destroyed, for which there are no reason nor is it possible to stop others in the vincinity from receiving this raw data.

Re: Avatarify lets users run realtime deepfakes on live video calls

#66
post #45

I am just waiting for someone to build a deep_nude_realtime_zoom plugin so I can finally tell people that we should take digital security, privacy and identity seriously.

That would give everyone an alibi and make them care even less about privacy.

If it truly becomes commonplace, then there is a chance video of any kind will lose some of its visual impact. Having seen enough of these, people will hopefully be more cautious about assuming videos are true.

Re: Avatarify lets users run realtime deepfakes on live video calls

#67

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

My opinion on this is that we will "soon" have "trusted" webcams that create some sort of signature in each frame. In other words, a way to say "this is what the camera saw, guaranteed".

Probably something that would be built into phones and laptops first.

Of course, we know that messing with such a datastream would be easy for us, but for enterprise users (think liability) and news organizations it could be a real boon.

Re: Avatarify lets users run realtime deepfakes on live video calls

#68

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

I was thinking the same thing today. I wonder if it can be done in on-the-spot, like capture your image from the camera initially and then send the rest as data points for deepfake generation on the other side, but based on your own image. That would be amazing for low/limited bandwidth situations.

Re: Avatarify lets users run realtime deepfakes on live video calls

#69
post #58

Earlier quoted context omitted.

Excellent idea and we'll surely be seeing something like this, there are AR apps that already map facial expressions to avatars. Downside could be some uncanny valley if the models are not very high quality. But if I had to make a prediction, I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really…

> I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really underestimate how important high definition is for human communication. Low latency is probably more important to me. Recently I seem to have a 3 second delay on many VC calls at work (and just for me it seems), and I either end up interrupt…

> Despite that I get a crystal clear HD picture for all participants, but I'd happily sacrifice video quality (in fact I'd accept audio only in some cases) to get a more real time experience (disabling video doesn't seem to have any effect).

If you're really willing to sacrifice video completely, at least for Zoom, and probably for lots of other videoconferencing solutions, you can call into meetings with your phone. In fact, I think Zoom allows you to join with the computer for video and the phone for audio, which might be the best of both worlds.

Re: Avatarify lets users run realtime deepfakes on live video calls

#70

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

My opinion on this is that we will "soon" have "trusted" webcams that create some sort of signature in each frame. In other words, a way to say "this is what the camera saw, guaranteed". Probably something that would be built into phones and laptops first. Of course, we know that messing with such a datastream would be easy for us, but for enterprise users (think liability) and news organizations it could be a real b…

That's when you point your camera at a screen.
Post reply on HN