Live data from Hacker News

Real-Time Noise Suppression Using Deep Learning

devblogs.nvidia.com

71–73 of 73 posts

Re: Real-Time Noise Suppression Using Deep Learning

#71

Earlier quoted context omitted.

How does multi microphone filtering work? I guess they localize different sound sources by cross-correlation (to get the timings) and triangulation (based on the timings and the speed of sound)?

It's pretty neat! Here's how it works: When you record with a single microphone, you are going to pick up a great deal of background noise. This is because the mic will pic up the person speaking AND the background noise; there's no way to differentiate the two. With two microphones, we know the following: 1) we know where the microphones are 2) we have a general idea where the persons mouth is, because we know how t…

That does sound neat. Sounds like it could be combined with 3D localization to allow eavesdropping particular sounds sources even e.g. in large rooms with lots of people talking. Multipath/ghosting might make precise localization difficult though.

Re: Real-Time Noise Suppression Using Deep Learning

#72

I downloaded the mac app, configured a virtual device to send the system output to the "Krisp Speaker" and verified that it cuts most of the music out of what I'm listening to, leaving only the voice (at a some what degraded quality). I wish I could configure it _cancel_ ambient noise, not just remove it from the input signal.

It'll not be quick enough for phase cancellation, but presumably you could diff the output with the input, phase-invert it, and get the signal you want that way.
Post reply on HN