Live data from Hacker News

Avatarify lets users run realtime deepfakes on live video calls

inputmag.com

51–60 of 127 posts

Re: Avatarify lets users run realtime deepfakes on live video calls

#51

I seriously wonder how this will affect online dating. Not that I've dated in quite a few years, but even if I wanted to, I wouldn't go back because last time I did, the proliferation of obnoxious Instagram filters and photoshopping made the experience unenjoyable. Fake people aren't appealing. I would bet that the ease at which the average person can deep fake will only make matters much worse. There will always be…

Why do you think people would use fake pictures on mass. If they wanted to create a profile with pictures that aren't themselves then surely it's easier to just steal someone else's?

Re: Avatarify lets users run realtime deepfakes on live video calls

#52

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

Even better would be for RPGs and things like Roll20. I’d love to deep fake different voices/ character faces on cue.

Re: Avatarify lets users run realtime deepfakes on live video calls

#53

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

This had already been done with criminals posing as CEOs.

Re: Avatarify lets users run realtime deepfakes on live video calls

#54
post #45

I am just waiting for someone to build a deep_nude_realtime_zoom plugin so I can finally tell people that we should take digital security, privacy and identity seriously.

That would give everyone an alibi and make them care even less about privacy.

I really wonder what government agencies will do with deepfakes. Will they doctrine evidence like they do now at a greater scale?

They already distribute CP, encourage people to believe in Russian conspiracies, troll, encourage violence and the list goes on. So fucked up that we think it is normal.

Re: Avatarify lets users run realtime deepfakes on live video calls

#55

I seriously wonder how this will affect online dating. Not that I've dated in quite a few years, but even if I wanted to, I wouldn't go back because last time I did, the proliferation of obnoxious Instagram filters and photoshopping made the experience unenjoyable. Fake people aren't appealing. I would bet that the ease at which the average person can deep fake will only make matters much worse. There will always be…

Why do you think people would use fake pictures on mass. If they wanted to create a profile with pictures that aren't themselves then surely it's easier to just steal someone else's?

Because they already do, to some extent. Now this is my own experience and intuition, but I would say that at least 15% of people's photos on dating apps are doctored in some way. I know some might dispute this, but I've seen enough questionable artifacts in such photos that I believe quite a few of them are artificially flattering. This isn't even including those puppy-face photos. And yes, already there are people who outright steal other people's photos. I've been on many dates where the person looked nothing like the photos.

There are a few problems with these kinds of fakery. If you are simply touching up photos to make them more flattering, that takes a lot of work that the average person doesn't want to do. There's AI that can make you look sexier, but said AI is often inconsistent, and isn't that good at arbitrarily modifying features. People who might want to use photos of people who aren't them may have a moral hangup from using someone else's likeness, and that prevents them from going ahead with it.

Deepfake technology solves both of those problems. You can use it to change your eyes, your hair, the shape of your face, consistently at every angle, and possibly I real time. More people would feel comfortable using a likeness that isn't theirs because they don't feel like they are stealing, especially if they have no intention of meeting people in real life.

I'm not saying that all or even most people would use this technology in dating, but it would require only an appreciable portion of an audience to be dishonest to cause many people to throw in the towel.

These are just my crazy theories, so maybe I'm way off base. Soon we will have deepfaking that is easy to use and requires minimal training, and I believe they will be used often and eventually be normalized in society.

Re: Avatarify lets users run realtime deepfakes on live video calls

#56
post #32

Theoretically you can deepfake yourself but then be not at the place, just pipe in your voice. Prob be accomplished by linking it to some Twilo API

Why would you do remote work even more remotely?

So you can go to the office ;-)

Re: Avatarify lets users run realtime deepfakes on live video calls

#57
Ok so how about an app that does the opposite of this, and can prove that the video/audio data hasn't been tampered with since it was created? I don't think it would need much more than public/private key encryption, and a blockchain ledger to record every-time the data was transmitted from one user to another. Thoughts?

Re: Avatarify lets users run realtime deepfakes on live video calls

#58

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

Excellent idea and we'll surely be seeing something like this, there are AR apps that already map facial expressions to avatars. Downside could be some uncanny valley if the models are not very high quality. But if I had to make a prediction, I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really…

> I'd expect we'll get much more value from higher bandwidth, ultra high definition streaming and features like 3d cameras / virtual reality. I think we have a tendency to really underestimate how important high definition is for human communication.

Low latency is probably more important to me.

Recently I seem to have a 3 second delay on many VC calls at work (and just for me it seems), and I either end up interrupting people or feeling reluctant to talk at all since it becomes impossible to time gaps and conversations right.

Despite that I get a crystal clear HD picture for all participants, but I'd happily sacrifice video quality (in fact I'd accept audio only in some cases) to get a more real time experience (disabling video doesn't seem to have any effect).

Re: Avatarify lets users run realtime deepfakes on live video calls

#59

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

I second the already expressed sentiments!

An utterly brilliant great idea!

Re: Avatarify lets users run realtime deepfakes on live video calls

#60

It would be interesting to see how far you could get using deepfakes as a method for video call compression. Train a model locally ahead of time and upload it to a server, then whenever you have a call scheduled the model is downloaded in advance by the other participants. Now, instead of having to send video data, you only have to send a representation of the facial movements so that the recipients can render it on…

[deleted]
Post reply on HN