Patent pending? The approach should be trivially obvious for anyone familiar with the basics.
What happened to the MIT License and liberating knowledge, does MIT not do that anymore?
The Visual Microphone: Passive Recovery of Sound from Video
11–20 of 41 posts
Re: The Visual Microphone: Passive Recovery of Sound from Video
#12could you do it the other way around?
how accurately can we recreate a 3d space from sound? what assumptions/information would you need to make it more accurate?
Re: The Visual Microphone: Passive Recovery of Sound from Video
#13They're making progress. At 5000 FPS, it's not surprising that they can recover audio. But from 60 FPS, that's striking. That works because some imagers don't take the whole frame at once.
And I suspect that you could combine video feeds from several lower speed cameras to give you an effective 1000FPS.
Re: The Visual Microphone: Passive Recovery of Sound from Video
#14Patent pending? The approach should be trivially obvious for anyone familiar with the basics. What happened to the MIT License and liberating knowledge, does MIT not do that anymore?
"It is a rare mind indeed that can render the hitherto non-existent blindingly obvious. The cry 'I could have thought of that' is a very popular and misleading one, for the fact is that they didn't, and a very significant and revealing fact it is too."
Re: The Visual Microphone: Passive Recovery of Sound from Video
#15They're making progress. At 5000 FPS, it's not surprising that they can recover audio. But from 60 FPS, that's striking. That works because some imagers don't take the whole frame at once.
And I suspect that you could combine video feeds from several lower speed cameras to give you an effective 1000FPS.
Yes but you have to precisely stagger the start of expositions of each camera and it's hard to do on consumer hardware.
Re: The Visual Microphone: Passive Recovery of Sound from Video
#16Previous discussion: https://news.ycombinator.com/item?id=8131785
I'll partially copy two interesting comments from that thread: > [A video with] 60 frames per second only allowed to identify the speaker and the number of people in the room. > The demo in the video is based on a high-speed (1000+fps) recording by a special camera, not on 'normal' video.
The first set of demos in the video, anyway. At the end they show the results of a special technique that uses 60fps video.
Re: The Visual Microphone: Passive Recovery of Sound from Video
#17Well that's pretty scary. I can see one application of this already: casinos in the US are legally prohibited from recording audio on their floors, but have perfectly positioned cameras everywhere. Beyond that, I'm guessing every spy agency on earth will be buying solutions based on this.
It would be interesting to know what the genesis of this project was - for example if the NSA or CIA was involved in suggesting to a professor that MIT take a look at this area. This is a very mission-specific technology.
Re: The Visual Microphone: Passive Recovery of Sound from Video
#18could you do it the other way around? how accurately can we recreate a 3d space from sound? what assumptions/information would you need to make it more accurate?
Yes. Look at the setup/calibration involved with Soundbar type audio systems.
Re: The Visual Microphone: Passive Recovery of Sound from Video
#19could you do it the other way around? how accurately can we recreate a 3d space from sound? what assumptions/information would you need to make it more accurate?
Yes. Look at the setup/calibration involved with Soundbar type audio systems.
awesome, thanks for the lead!
i will look it up, i am mostly curious about it's resolution. for instance, my unqualified hunch is that the algorithm couldn't detect the size of the dog in my room based on a microphone recording.
i guess the more calibration involved the easier the problem becomes. but that is no fun. :)
Re: The Visual Microphone: Passive Recovery of Sound from Video
#20Patent pending? The approach should be trivially obvious for anyone familiar with the basics. What happened to the MIT License and liberating knowledge, does MIT not do that anymore?
Don't mean to put too fine a point on it, but could you give me any example of an invention throughout history that you would not class as obvious? I'm wondering what your standards are.