Live data from Hacker News

Enhanced noise suppression in Jitsi Meet

jitsi.org

71–80 of 88 posts

Re: Enhanced noise suppression in Jitsi Meet

#71
This looks interesting.

Most devices have noise suppression built in. Do you use RNNoise in tandem with the hardware noise suppression, or do you disable it?

Also, are there any plans to implement this with react-native on mobile? And if so, how would you implement this, since audio worklets and WebAudio aren't available.

Re: Enhanced noise suppression in Jitsi Meet

#72

Earlier quoted context omitted.

Apparently FaceTime offers this. [1] Presumably Apple will allow other companies to do it as well, since they let them offer spatial audio in other contexts. 1: https://support.apple.com/guide/iphone/change-the-audio-sett...

Why would Apple need to allow it? It's simply a matter of a given program postprocessing the various audio streams appropriately prior to muxing them for output.

Because Apple’s spatial audio varies as you rotate your head. The device knows where your head is located, but the app doesn’t (unless the OS tells it).

Re: Enhanced noise suppression in Jitsi Meet

#73

Anyone have tips for using Jitsi? I've been thinking about moving off Zoom now that they're enforcing a 40 min limit even for one-on-one calls. Does it create friction for folks who haven't used it before? Any suggested instructions to send with a meeting invite?

I love Jitsi. Super easy to get people to join and learn the UI. Reliable and fast. Audio beats regular phone calls.

Re: Enhanced noise suppression in Jitsi Meet

#75
post #23

Sorry, but at least in my smartphone, I can understand better the unprocessed audio showcased down in the Web page, than the noise-suppresed audio. How is that?

The original audio is significantly easier to understand. This may be technically interesting, but the noise suppression is aggressive to the point that it's eating critical signal with the noise.

https://jmvalin.ca/demo/rnnoise/ says:

> So what should you listen for anyway? As strange as it may sound, you should not be expecting an increase in intelligibility. Humans are so good at understanding speech in noise that an enhancement algorithm — especially one that isn't allowed to look ahead of the speech it's denoising — can only destroy information. So why are we doing this in the first place? For quality. The enhanced speech is much less annoying to listen to and likely causes less listener fatigue.

> Actually, there are still a few cases where it can actually help intelligibility. The first is videoconferencing, when multiple speakers are being mixed together. For that application, noise suppression prevents the noise from all the inactive speakers from being mixed in with the active speaker, improving both quality and intelligibility. A second case is when the speech goes through a low bitrate codec. Those tend to degrade noisy speech more than clean speech, so removing the noise allows the codec to do a better job.

I do think that for direct listening, the jitsi.org speech samples would be slightly more intelligible if the noise removal was tuned to pass through frequencies with mixed noise and signal. I don't know if that would be worse in a video conference. Does the speaker or listener get to choose between conservative and aggressive noise removal?

Re: Enhanced noise suppression in Jitsi Meet

#76
post #8

Earlier quoted context omitted.

Aside from consuming a ton of resources when screen sharing, my experience with Jitsi meet has been very good. It consumes two cores of my 5900X (1 for the Firefox process, and another for some system process I don’t recall exactly) but it works. This was with sharing a 4K screen. I have run jitsi on cheap VMs and it worked decently. But you need quite some cores to serve all the traffic. Ultimately I ended up having…

how is the meet.jit.si hosted? i assume with lots and lots of random users, the bandwidth and processing costs to be astronomical

For a large proportion of users I expect the audio/video to be peer to peer thanks to WebRTC. Other traffic (for that set of users) should be minimal.

Re: Enhanced noise suppression in Jitsi Meet

#77
post #74

Aside, Jitsi is pretty awesome for creating an video app idea quickly. The API is very easy to use.

SignalWire's SDK is another option and it uses an MCU instead of SFU: https://signalwire.com/products/cloud-video

Wow their prices remind me of 90s phone calls

Re: Enhanced noise suppression in Jitsi Meet

#78
post #57

Anyone have tips for using Jitsi? I've been thinking about moving off Zoom now that they're enforcing a 40 min limit even for one-on-one calls. Does it create friction for folks who haven't used it before? Any suggested instructions to send with a meeting invite?

We've been using jitsi via zulip chat at work. It should be drop-in for at least small groups (one-on-one, handful of people - I have yet to investigate "conference" or "class room" size). We do unfortunately see semi-regular lock-up/freezes where one end of the stream stops for ~30 seconds. Maybe this is worse in safari vs chrome/Firefox - we have not yet experimented much with different browsers. Or maybe there's a…

AudioWorklet and WebAudio in general are buggy in Safari.

- https://bugs.webkit.org/show_bug.cgi?id=244203 - https://bugs.webkit.org/show_bug.cgi?id=241223 - https://bugs.webkit.org/show_bug.cgi?id=221334

Re: Enhanced noise suppression in Jitsi Meet

#80
post #30
post #13

Earlier quoted context omitted.

Is this a troll comment? Yes, wasm works based on a compiled binary, just like any other program written in a compiled language in the past 50 years. You try to suggest that everyday users of the web are just going into the js sources of webpages and understand whats going on. With the plethora of libraries, frameworks and static optimization used in todays websites, normal people can't really dissect the inner worki…

Sure “everyday users” aren’t clicking “View Source”, but that’s not really what the issue is about. When I was a kid, every piece of software I used was pre-compiled, and therefore opaque. This made it difficult for me to figure out how people made certain things, and after a while I lost interest in programming. When I got back into it later, one thing that made a huge difference was being able to see how various co…

You're really not going to "view source" and understand anything when all the JS I ship is minified and uglified. Nowadays, JS is simply another compile target.
Post reply on HN