What about to process some movies with this method, anyone?
If you watch closely enough, everything is a speaker
11–20 of 54 posts
Re: If you watch closely enough, everything is a speaker
#12> The group tested an eclectic selection of materials, including a bag of chips (excellent), a soda can (surprisingly mediocre), and a potted plant (average). They were even able to recreate music playing using footage of the vibrating ear buds. The best material of all was the thin foil wrapper on a Lindt chocolate bar Davis had been snacking on.
I hope it was the journalist who thought the soda can was surprisingly mediocre and not the researchers. The soda can is immensely stiff compared to the foil and much heavier so it will not move so much, meaning that there is simply less for the camera to see.
Re: If you watch closely enough, everything is a speaker
#13Another cool thing is recovery of picture from ambient reflected light. Sadly it only works on CRTs.
Re: If you watch closely enough, everything is a speaker
#14I wonder if this could be applied to normal video and get results useful for any purposes. I realize it would be lower quality, but I feel like it might be possible to detect nearby gunshots on security camera footage that doesn't have audio. How cool would it be to see a murder trial enter audio recovered from footage of a house plant as evidence?
See this - https://youtu.be/FKXOucXB4a8?t=187
They show audio captured from a 60fps video from a DSLR exploiting the rolling shutter. I'm not sure if you can use less than 60fps though?
Re: If you watch closely enough, everything is a speaker
#15Re: If you watch closely enough, everything is a speaker
#16Isn't this how those laser microphones work?
This is passive, laser microphones are active. I think another difference is laser microphones use motion parallel to the axis of the beam, whereas this is motion in the plane perpendicular to the line of sight.
Re: If you watch closely enough, everything is a speaker
#17Earlier quoted context omitted.
The original research in 2014 is presented well. This article in 2018 butchers the terminology, using "speaker" instead of "microphone".
Speakers and microphones are both transducers, which is what the author seems to be getting at.
But leafs shake because they receive waves. Not the other way around.
Re: If you watch closely enough, everything is a speaker
#18Re: If you watch closely enough, everything is a speaker
#19Earlier quoted context omitted.
Speakers and microphones are both transducers, which is what the author seems to be getting at.
But leafs shake because they receive waves. Not the other way around.
Another valid metaphor though is that video of the leaves can be decoded the same way video of a speaker would. The analogy works either way.
Re: If you watch closely enough, everything is a speaker
#20Silly question: isn't this phenomenon bound by the Nyquist limit, which means it would take at the very least 4k fps to reconstruct music (considering that a soprano can get no higher than 2 kHz)? That sounds like an impossibly high framerate.