Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

Post reply on HN
Print view View original

111–120 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#111

Post by yodon »

mdeligoz wrote: post #34

Hey guys! I'm one of the founders of Impressions, the first mobile deepfake app on a phone. Try it out and give us your thoughts. Right now it's out for IOS but Android is on route. Here's our website https://impressions.app

I strongly recommend you read up on "Likeness Rights" (as in celebrity likeness rights) - they are a big deal, particularly for any product that is available within the state of California (which has extremely strong laws around them). As your product stands today you will be sued and you will lose because you are absolutely using celebrity likenesses to sell your product in the Apple Store. It doesn't matter whether the images you generate are debatably non-celebrity or not because you're using the likeness of specific celebrities to sell the app.

For reference on Likeness Rights, one of Kevin Smith's Jay and Silent Bob movies has an entire sub-plot that revolves around the financial significance of likeness rights.

Re: Avatarify lets users run realtime deepfakes on live video calls

#112

Post by bawana »

I ran this on ubuntu 18.04. It took a little work to get around a small bug that will be squashed when the v412loopback library gets officially rebuilt but here is a solution https://github.com/alievk/avatarify/issues/37#issuecomment-6...

anyway, on a 4930k at 4.5 ghz i am seeing reasonable performance(~30fps) but minimal cuda utilization(titan pascal). The biggest issue is that you need a well lit, stationary face for it to properly map features of the jpg you are using to substitute for your face. Also the jpg needs clearly identifiable features. Even then, the amount of facial expression is subdued (for example closing your eyes is not properly processed).

I seem to recall software about 10 years ago where you drew line segments of corresponding features on 2 images and the jpg was then mapped onto the video. It was more accurate and expressive than this is but did require time to set up.

Re: Avatarify lets users run realtime deepfakes on live video calls

#113

Post by luhem7 »

cheez wrote: post #91
teraflop wrote: post #63

Earlier quoted context omitted.

This is a minor plot point in Vernor Vinge's excellent SF novel A Fire Upon the Deep . One of the premises of the novel's universe is that computational power is generally absurdly plentiful, but communications bandwidth over interstellar distances is not. Most communications are in plain text (modeled after USENET) but in some cases, "evocations" are used to extrapolate video and audio from an ultra-compressed data…

A main premise of the Fear the Sky trilogy as well but solved a different way. Machines representing various political factions from the home planet are uploaded with AI that mimics them emotionally and politically for all intents and purposes. I really enjoyed this book.

Eh, I personally enjoyed the series, but I wouldn't recommend anything beyond book 1. Book 2 is ok. Book 3 really spoiled the series for me because of the inconsistent behavior if the main character. (Keeping it vague to avoid spoilers)

Re: Avatarify lets users run realtime deepfakes on live video calls

#114

Post by rglullis »

jessaustin wrote: post #108
rglullis wrote: post #87

81 comments at the moment and not one single mention of Infinite Jest?! How disappointing...

I read that over 20 years ago; could you explain the relevance? deepfakes or something similar would have fit right in with "the entertainment" etc., but I don't recall that happening... In general I find that adding an oblique reference is more appreciated on HN than simply name-dropping a particular fictional work.

In the book there is a long passage about how video calls were initially very popular, but after a while people realized that with video calls they were supposed to be looking to the screen all the time and how that led to unnecessary anxiety - e.g, on the telephone you could talk on the phone while clipping your nails, on the video it would never happen.

There is also a part where people had to start worrying about their looks on the screen, so that led to a cottage industry of virtual make-up, stand-ins to pose in front of the camera while you could stay away, etc. After everyone realizes that no one is actually in front of the camera anymore, people start going back to regular phone calls.

Re: Avatarify lets users run realtime deepfakes on live video calls

#115

Post by abledon »

Der_Einzige wrote: post #14
qznc wrote: post #2

Voice fake has been done already as well. https://github.com/CorentinJ/Real-Time-Voice-Cloning

As someone whose tried this repo extensively with politican sound clips (I wanted to troll buddies on discord) - it kinds blows. Don't get me wrong - it's really neat but the results are far less good than one may expect. Sometimes it almost works, and then it's just totally absurd. Long pauses, voices that don't sound compelling, total failures on female voices. It's great in theory but it showed me that there's a t…

could you post some examples with dropbox of the 'less than stellar' results you were getting?

Re: Avatarify lets users run realtime deepfakes on live video calls

#116

Post by userbinator »

JimDabell wrote: post #37

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on their end.

The MPEG-4 part 2 actually had something like that, called "face and body animation (FBA)". As far as I know, there are no implementations in widespread use.

Re: Avatarify lets users run realtime deepfakes on live video calls

#117

Post by 101404 »

DFHippie wrote: post #94
101404 wrote: post #73

From the site's text: > and plenty of Americans and Russian's willing to use whatever means necessary to ensure Trump gets re-elected That is not what the Russian attacks are about. In fact, the maker of the site seems to have fallen for the attacks himself. The attacks are about dividing society. Radicalizing people towards the left and right. The "Trump haters" are just the same as the "Trump fanatics". The author,…

Both things can be true. They don't really care for Trump personally, they just want to sow discord, but Trump is a great way to sow discord. Non-Russian-aligned intelligence agencies were pretty unanimous in their assessment that Putin was trying to get Trump elected and that they troll both extremes of the political spectrum.

Wasn't there an investigation that found no evidence on that?

Re: Avatarify lets users run realtime deepfakes on live video calls

#118

Post by jonny383 »

dawnerd wrote: post #81

I don’t understand why everything thinks they have to be on video for every single meeting. I never turn on my webcam. It makes no difference to the outcome of the call.

I guess we should all start wearing blindfolds in face-to-face meetings because it will make no difference to the outcome of the meeting.

Re: Avatarify lets users run realtime deepfakes on live video calls

#119

Post by james_s_tayler »

perf1 wrote: post #25
odnes wrote: post #10

All the new mobile banks seem to do their ID verification/KYC using video selfies. Interesting to consider whether deepfakes are being used in wild to fool these systems and commit fraud.

They try to mitigate this. They ask you for example to move your hands around your face and bend your ID card.

Just apply the same technology to mitigate their mitigation. Arms race all the way down.
Post reply on HN