Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

To uncover a deepfake video call, ask the caller to turn sideways

metaphysic.ai

Post reply on HN
Print view View original

41–50 of 285 posts

Re: To uncover a deepfake video call, ask the caller to turn sideways

#41

Post by PeterisP »

bnt wrote: post #23
hotpotamus wrote: post #15

Earlier quoted context omitted.

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and it was not able to answer. Interestingly, this is a question my father would ask patients as a paramedic who was trying to assess people's consciousness. Another would be, "what day of the week is it?". I'd say that these technologies are just like magic - they…

Depending where the bot is and what time of day it is, it might tell you the wrong day of the week.

For current mainstream text generation models it doesn't really depend on where the bot is and what time of the day it is, that's kind of the whole point - their text generation process simply doesn't use the current time as a possible input factor, these models would provide the exact same result (or random picks from the exact same distribution of potential results) no matter when and where you run them.

They would be expected to answer with something matching the day/time distribution that was represented in the training data they used; like the answer to various prompts of the "current president" question is dominated by Trump, Obama and a bit of Bush and Clinton, simply because those are the presidents in the training data and the more recent events simply aren't there yet - like the many models who have no idea how to interpret the word 'Covid' simply because they have been trained on pre-2020 data even if the model was built and released later.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#44

Post by bombcar »

unsupp0rted wrote: post #20
hotpotamus wrote: post #15

Earlier quoted context omitted.

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and it was not able to answer. Interestingly, this is a question my father would ask patients as a paramedic who was trying to assess people's consciousness. Another would be, "what day of the week is it?". I'd say that these technologies are just like magic - they…

I'm not sure there's a basic question we can ask that a lot of human users wouldn't fail. President of the country? Too difficult.

The point isn't to check if they actually know - it's to gauge the response. If they say "I don't know" that may be a valid answer, but if they say "George Bush" then something is seriously wrong.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#47

Post by ghaff »

phpnode wrote: post #17
bearjaws wrote: post #14

Serendipitously over the weekend I was thinking about a future where for key sensitive data access (e.g. production main) you may need to have a quick 5 minute call (4th factor, "3D verification") where you would be asked to turn on your camera and be asked to answer some simple question and in different positions... Main thinking was how out of control it would get, it would probably end up looking like anti-cheat s…

in the UK this is already relatively common for online banking. I asked my bank to raise my daily transfer limit the other day for a property purchase and part of the process was recording a video of myself in their app.

And, of course, as barriers are raised it makes it very difficult for some portion of the population (and less convenient for everyone else). I have to change addresses for an older person at a couple of banks and I'm sure it's going to be a nightmare.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#48

Post by elondaits »

sbszllr wrote: post #18

Source: I work in the field. This is a current limitation, and an artifact of the data+method but not something that should be relied upon. If we do some adversary modelling, we can find two ways to work around this: 1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones. 2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fie…

“The Impossible Mission Force has the technical capabilities to copy anyone’s face and imitate their voice, so don’t base your secops around someone’s appearance.”

… yes, because that worked well.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#49

Post by eckza »

isusmelj wrote: post #35

Deepfake models are trained on very similar data. They don't generalize well, usually. E.g. we take lots of data from YouTube videos of a single person under a specific condition (same time, same day, same haircut etc.) I know that as I spent quite some time researching these models and worked on a deepfake detection startup. Purely looking at it from a technological side, it's a cat mouse game. Similar to an antivir…

> Put shoe on head

Re: To uncover a deepfake video call, ask the caller to turn sideways

#50

Post by tiborsaas »

elygre wrote: post #43
t_mann wrote: post #31

Omg, looking forward to Yoga-based Captchas in the future: That ain't looking like a proper downward dog to me, pal, no access for you

No no... this does look like a proper downward dog, but no way you could do that!

Please say "I'm not a robot" with a Scottish accent 3 times and do a backflip to login.
Post reply on HN