I am just worried that they are picking up part of information from camera mic. Maybe camera mic output is not totally independent from the video sensor, and is encoded in the final video.
Extracting audio from visual information
31–40 of 133 posts
Re: Extracting audio from visual information
#32I am just worried that they are picking up part of information from camera mic. Maybe camera mic output is not totally independent from the video sensor, and is encoded in the final video.
Re: Extracting audio from visual information
#33Re: Extracting audio from visual information
#34Incredible and terrifying at the same time. If they're doing this kind of stuff right now with consumer cameras, imagine how effective this technology will be in just a few decades. Privacy is fading quickly with the advent of exciting technology like this.
you need a camera that captures at least 2,000 frames per second.
Re: Extracting audio from visual information
#35Incredible and terrifying at the same time. If they're doing this kind of stuff right now with consumer cameras, imagine how effective this technology will be in just a few decades. Privacy is fading quickly with the advent of exciting technology like this.
you need a camera that captures at least 2,000 frames per second.
Re: Extracting audio from visual information
#36I am just worried that they are picking up part of information from camera mic. Maybe camera mic output is not totally independent from the video sensor, and is encoded in the final video.
They put the camera behind soundproof glass for one of their tests.
Re: Extracting audio from visual information
#37Re: Extracting audio from visual information
#38Because of a quirk in the design of most cameras’ sensors, the researchers were able to infer information about high-frequency vibrations even from video recorded at a standard 60 frames per second. Can anyone explain what this quirk is?
Re: Extracting audio from visual information
#39Earlier quoted context omitted.
you need a camera that captures at least 2,000 frames per second.
> Because of a quirk in the design of most cameras’ sensors, the researchers were able to infer information about high-frequency vibrations even from video recorded at a standard 60 frames per second.
Edit: They mention capturing frequencies up to five times higher than the 60Hz frame rate, which would mean a maximum frequency of 300Hz, which would suggest the equivalent of 0.6kHz audio, which is a 73.5th of the audio rate of a CD. I doubt you'd get intelligible speech from current consumer hardware using this technique.
Re: Extracting audio from visual information
#40I am just worried that they are picking up part of information from camera mic. Maybe camera mic output is not totally independent from the video sensor, and is encoded in the final video.