Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

71–80 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#71

I’m sure we will see more and more of this. One question is when they get so good, how can people figure out that it’s a deep fake or a real human? Will we have captchas for videos soon ? sigh

Ask the person to turn their head left and right. Or to put on glasses. Combine simple tests like this and it becomes exponentially more complex for the gadget to pass them.

Re: Avatarify lets users run realtime deepfakes on live video calls

#72

Earlier quoted context omitted.

This is a minor plot point in Vernor Vinge's excellent SF novel A Fire Upon the Deep . One of the premises of the novel's universe is that computational power is generally absurdly plentiful, but communications bandwidth over interstellar distances is not. Most communications are in plain text (modeled after USENET) but in some cases, "evocations" are used to extrapolate video and audio from an ultra-compressed data…

> it's not very obvious what aspects of the image you're seeing are real, and what aspects were dreamed up by the system doing the extrapolating. It would be quite obvious unless the raw data before extrapolating is destroyed, for which there are no reason nor is it possible to stop others in the vincinity from receiving this raw data.

That assumes that the "raw data" is reasonably human-comprehensible (which neural network weights and activations are notoriously not) and/or that you have time to sit down and analyze the data at your leisure.

But saying more would be spoilery...

Re: Avatarify lets users run realtime deepfakes on live video calls

#73
From the site's text:

> and plenty of Americans and Russian's willing to use whatever means necessary to ensure Trump gets re-elected

That is not what the Russian attacks are about.

In fact, the maker of the site seems to have fallen for the attacks himself.

The attacks are about dividing society. Radicalizing people towards the left and right. The "Trump haters" are just the same as the "Trump fanatics".

The author, by implying that the "bad guys" are just one site, is playing into the hands of the Russian trolls. Its exactly what the attacks are trying to achieve.

Re: Avatarify lets users run realtime deepfakes on live video calls

#76

Earlier quoted context omitted.

My opinion on this is that we will "soon" have "trusted" webcams that create some sort of signature in each frame. In other words, a way to say "this is what the camera saw, guaranteed". Probably something that would be built into phones and laptops first. Of course, we know that messing with such a datastream would be easy for us, but for enterprise users (think liability) and news organizations it could be a real b…

That's when you point your camera at a screen.

Will the "trusted" webcam manufacturers then attempt to detect any screen curvature?

Re: Avatarify lets users run realtime deepfakes on live video calls

#77
post #73

From the site's text: > and plenty of Americans and Russian's willing to use whatever means necessary to ensure Trump gets re-elected That is not what the Russian attacks are about. In fact, the maker of the site seems to have fallen for the attacks himself. The attacks are about dividing society. Radicalizing people towards the left and right. The "Trump haters" are just the same as the "Trump fanatics". The author,…

[deleted]

Re: Avatarify lets users run realtime deepfakes on live video calls

#78

Earlier quoted context omitted.

This is a minor plot point in Vernor Vinge's excellent SF novel A Fire Upon the Deep . One of the premises of the novel's universe is that computational power is generally absurdly plentiful, but communications bandwidth over interstellar distances is not. Most communications are in plain text (modeled after USENET) but in some cases, "evocations" are used to extrapolate video and audio from an ultra-compressed data…

> it's not very obvious what aspects of the image you're seeing are real, and what aspects were dreamed up by the system doing the extrapolating. It would be quite obvious unless the raw data before extrapolating is destroyed, for which there are no reason nor is it possible to stop others in the vincinity from receiving this raw data.

For that to be true the compression algorithm mustn’t be very efficient.

Re: Avatarify lets users run realtime deepfakes on live video calls

#79

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

Google recently introduced something like that for Audio in Duo: https://ai.googleblog.com/2020/04/improving-audio-quality-in...

> WaveNetEQ is a generative model, based on DeepMind’s WaveRNN technology, that is trained using a large corpus of speech data to realistically continue short speech segments enabling it to fully synthesize the raw waveform of missing speech.

I don't think you need to train for each person specifically, you can just train a model for all heads, then maybe transmit a few high quality pics when the call starts, and interpolate from that afterward.

Re: Avatarify lets users run realtime deepfakes on live video calls

#80
post #62
post #57

Ok so how about an app that does the opposite of this, and can prove that the video/audio data hasn't been tampered with since it was created? I don't think it would need much more than public/private key encryption, and a blockchain ledger to record every-time the data was transmitted from one user to another. Thoughts?

How would you prevent against a deepfake program presenting itself as a camera? From your applications perspective, it's raw data directly from the camera but there's no guarantee the camera is just a camera.

The "secure video stream" would probably need to be baked into the hardware, like Apple's Secure Enclave https://support.apple.com/guide/security/secure-enclave-over...
Post reply on HN