And now think of how much high definition video, CCTV, and other forms of recordings already exist.. and then think about running large collections of pre-existing video through such algorithms, along with the best speech-to-text in the business. You could have a whole new Wikileaks on your hands :-)
Extracting audio from visual information
11–20 of 133 posts
Re: Extracting audio from visual information
#12Re: Extracting audio from visual information
#13And now think of how much high definition video, CCTV, and other forms of recordings already exist.. and then think about running large collections of pre-existing video through such algorithms, along with the best speech-to-text in the business. You could have a whole new Wikileaks on your hands :-)
If you want to record a particular person through a window, for instance, you can get a laser microphone that catches the vibrations of the glass.
Re: Extracting audio from visual information
#14Re: Extracting audio from visual information
#15It doesn't seem to mention what kind of camera you'd need to do this at the mentioned distance (15 feet). I'm assuming it's at least a couple thousand bucks, or maybe even so expensive that most professional photographers won't have it, but does anyone actually know? Or did I miss it in the article?
Re: Extracting audio from visual information
#16Re: Extracting audio from visual information
#17Re: Extracting audio from visual information
#18Earlier quoted context omitted.
Cameras basically read their sensors one row of pixels at a time. By measuring the distortion of each row, they can detect vibrations higher than the camera's frame rate.
So it's like if 960-row video at 60fps were actually a 57600 rows-per-second video, right? Which they can extract info from because having more rows in a still frame doesn't mean having more information (at least not linearly), i.e. in still frames with no rolling shutter, rows contain redundant vibration already extracted from previous rows. So having a rolling shutter is good for this specific application because i…
Re: Extracting audio from visual information
#19It doesn't seem to mention what kind of camera you'd need to do this at the mentioned distance (15 feet). I'm assuming it's at least a couple thousand bucks, or maybe even so expensive that most professional photographers won't have it, but does anyone actually know? Or did I miss it in the article?
1) A lot of the tests were done with a camera that costs thousands of dollars. You can see images of the camera used in one of the experiments.
2) They were able to use consumer-grade cameras to also capture sound. Even frequencies up to 5x higher than the actual 60 FPS of the captured video.
Re: Extracting audio from visual information
#20This is from the movie Eagle Eye, right? The evil computer watches the vibrations in a cup of coffee while someone is speaking.