Live data from Hacker News

To uncover a deepfake video call, ask the caller to turn sideways

metaphysic.ai

91–100 of 285 posts

Re: To uncover a deepfake video call, ask the caller to turn sideways

#92

Deepfake models are trained on very similar data. They don't generalize well, usually. E.g. we take lots of data from YouTube videos of a single person under a specific condition (same time, same day, same haircut etc.) I know that as I spent quite some time researching these models and worked on a deepfake detection startup. Purely looking at it from a technological side, it's a cat mouse game. Similar to an antivir…

Looking at how fast dall-e is improving, and how it "understands" concepts even if you mix them in crazy ways, all of your later examples seem solvable in less than a decade.

But I don't know much about ML so I might be wrong.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#93

Earlier quoted context omitted.

That's "bread and butter" work in VFX. I used to be a stunt double actor replacement specialist. These daze, ML enhanced tools make the work for a face replacement shot exponentially faster and easier - as is needed for the huge number of superhero stunts insurance companies will not let the stars perform.

So do we really know that Tom Cruise is doing his own stunts as claimed?

The fact that Tom Cruise appears to not have aged in 30 years might be telling!

Re: To uncover a deepfake video call, ask the caller to turn sideways

#94
post #63

Is audio harder to fake than video? I was watching the Keanu one and wondered if it is harder to real time fake Keanu’s voice than his face?

No. Both face the same challenge - quality of data. The rest has already been solved.

Does this mean any possible audio or video a real human can do, current ML can fake with enough quality of data? Like there's no possible test a real human can do which can't be faked, given the relevant data?

Re: To uncover a deepfake video call, ask the caller to turn sideways

#95
post #18

Source: I work in the field. This is a current limitation, and an artifact of the data+method but not something that should be relied upon. If we do some adversary modelling, we can find two ways to work around this: 1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones. 2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fie…

I wonder how good the deepfake would be for things it didn't have training data on. For example, making an extreme grimace. Or have the caller insert a ping pong ball in his cheek to continue, or pull his face with his fingers. One thing I notice with colorized movies is the color of the actor's teeth tends to flicker between grey and ivory. I wonder if there are similar artifacts with deep fakes.

Please drink a verification can to continue, caller.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#96

"profile view challenge" coming in 3, 2, 1 ...

"Hey! To make sure you stay secure, we require a short video. Please look straight into the camera and tap the screen."

"You look great! We just need you to blink 5 times, and you're almost done!"

"Almost done! Just show us your best side and turn your head to the left like shown above."

"Of course, you only have best sides. Just turn your head to the right like displayed above, and we can continue."

"You've almost got it! Please open your mouth and show us your teeth."

"Wow, look at you go! Just one step remaining: Tilt your head to the right like shown above."

"Now, to complete your verification, hold your national ID beside your face. Make sure it does not obstruct your head! We need to be able to see your pretty face!"

(Tongue in cheek, of course. But my banking app actually uses this kind of language, even for verification stuff, and I don't like it :D)

Re: To uncover a deepfake video call, ask the caller to turn sideways

#97
post #18

Source: I work in the field. This is a current limitation, and an artifact of the data+method but not something that should be relied upon. If we do some adversary modelling, we can find two ways to work around this: 1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones. 2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fie…

Last time I applied for a credit card online, they asked me to take a video of myself and turn my head from side to side.

Yeah this is quite common with fintech (stock brokers and crypto IME) KYC nowadays I've noticed.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#98
post #18

Source: I work in the field. This is a current limitation, and an artifact of the data+method but not something that should be relied upon. If we do some adversary modelling, we can find two ways to work around this: 1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones. 2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fie…

Last time I applied for a credit card online, they asked me to take a video of myself and turn my head from side to side.

And now that scan could eventually end up out there someplace.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#99
post #52

I was recently looking for designers for my company when I came across an interesting profile on Dribbble. I reached out and quickly scheduled a time when we could talk over zoom. At the meeting time, in comes this person who seems to have a strange-looking, silicone-like face. I was using my Zoom account (I rarely use other peoples zooms unless I trust them), to avoid situations like this. One thing I noticed is tha…

Out of curiosity was that person asian?

Maybe they were just using some of those beautifying filters like chinese streamers do.

Post reply on HN