Live data from Hacker News

To uncover a deepfake video call, ask the caller to turn sideways

metaphysic.ai

11–20 of 285 posts

Re: To uncover a deepfake video call, ask the caller to turn sideways

#12

Tangentially related but a simple way to bust a chatbot is to ask “What is larger, the Eiffel Tower or a shoe box?”

Here's what Meta's blenderbot replied with: "The Tokyo tower is taller than the eiffel tower. Interesting facts like that interest me. Do you know about it?"

Re: To uncover a deepfake video call, ask the caller to turn sideways

#14
Serendipitously over the weekend I was thinking about a future where for key sensitive data access (e.g. production main) you may need to have a quick 5 minute call (4th factor, "3D verification") where you would be asked to turn on your camera and be asked to answer some simple question and in different positions...

Main thinking was how out of control it would get, it would probably end up looking like anti-cheat systems where its a constant cat and mouse game due to growing sophistication of deep fake models.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#15

Tangentially related but a simple way to bust a chatbot is to ask “What is larger, the Eiffel Tower or a shoe box?”

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and it was not able to answer.

Interestingly, this is a question my father would ask patients as a paramedic who was trying to assess people's consciousness. Another would be, "what day of the week is it?".

I'd say that these technologies are just like magic - they can seem to do things that defy your expectations, but oftentimes they fall apart when looked at from a different angle.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#17

Serendipitously over the weekend I was thinking about a future where for key sensitive data access (e.g. production main) you may need to have a quick 5 minute call (4th factor, "3D verification") where you would be asked to turn on your camera and be asked to answer some simple question and in different positions... Main thinking was how out of control it would get, it would probably end up looking like anti-cheat s…

in the UK this is already relatively common for online banking. I asked my bank to raise my daily transfer limit the other day for a property purchase and part of the process was recording a video of myself in their app.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#18
Source: I work in the field.

This is a current limitation, and an artifact of the data+method but not something that should be relied upon.

If we do some adversary modelling, we can find two ways to work around this:

1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones.

2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fields) to faces; matter of time.

Now, if your company/government is on the bleeding edge of ML-based deception, they can have such policy, and they will update it 12-18-24 months (or whenever (1) or (2) materialises). However, I don't know one organisation that doesn't have some outdated security guideline that they cling to, e.g. old school password rules and rotations.

Will "turning sideways to spot a deepfake" be a valid test in 5 years? Prolly no, so don't base your secops around this.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#19
post #18

Source: I work in the field. This is a current limitation, and an artifact of the data+method but not something that should be relied upon. If we do some adversary modelling, we can find two ways to work around this: 1) actively generate and search for such data; perhaps expensive for small actors but not well equipped malicious ones. 2) wait for deep learning to catch up, e.g. by extending NERFs (neural radiance fie…

As far as I can see, secops is an eternal cat-and-mouse game.

Re: To uncover a deepfake video call, ask the caller to turn sideways

#20

Tangentially related but a simple way to bust a chatbot is to ask “What is larger, the Eiffel Tower or a shoe box?”

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and it was not able to answer. Interestingly, this is a question my father would ask patients as a paramedic who was trying to assess people's consciousness. Another would be, "what day of the week is it?". I'd say that these technologies are just like magic - they…

I'm not sure there's a basic question we can ask that a lot of human users wouldn't fail. President of the country? Too difficult.
Post reply on HN