Live data from Hacker News

Enhanced noise suppression in Jitsi Meet

jitsi.org

31–40 of 88 posts

Re: Enhanced noise suppression in Jitsi Meet

#31
post #25

Bummer, reading the title I thought Jitsi had a new de-noiser because they had RRNoise for some time. Unfortunately RRNoise has not received much advancement for a couple years. It's by now half a decade old tech. I've worked with the WASM version in the past but it can be hit or miss. Sometimes it makes the audio you want a bit weird. It also added something like 10% CPU usage and in the end we disabled it again. I'…

While we’ve had rnnoise integration for a while it was for “noisy environment” notifications, this is the first time we use it to actually filter audio.

Also audio worklets weren’t a thing when we first introduced it.

I’m not aware of any other open source (and better) models, but if any come up, we’ll certainly check them out!

Re: Enhanced noise suppression in Jitsi Meet

#33
post #27
post #19

Earlier quoted context omitted.

They didn't suggest the web is doomed, just that more aspects of it are opaque. I don't think they're talking about every day users of the web either, but rather nascent developers. The early web was a great equalizer. Anybody could study a little html, download an ftp manager, jump through a few procedural hoops and have a web page. After some studying and trial and error they could even build an interactive site.[1…

Are modern-day "no code" tools like Webflow not an acceptable equivalent? We already lost any semblence of building from scratch in the mid-2000s with the emergence of gargantuan HTML templates and Wordpress/Drupal/PHPbb deployments with plugins and themes. This is a direct result of people being held to higher standards and thus spending a lot more effort overriding the compositional and behaviour defaults of the us…

Build from scratch is out of favor, but not necessarily that far off. Folks like Github & Youtube have very simple bottom-up webcomponent systems they use, rather than top doen frameworks. Existing concerns about bundling might be met by bundled http exchamges (webpackage).

I dont think "no code" is an aid. If anything it's pushing in the opposite direction: rather than a transparent approachable web medium, it suggests we need hyperadvanced tools that we really wont understand or have control over to synthesize web code. It's a simpler user experience, but a push away from notepad.exe webdev.

I wouldnt rush to make any conclusions about who or what has won, as a settled fact & case for all time. We havent had good ways to run online systems ourselves, versus hosted for us, and there's still lightyears to go but we're doing good things & finally maturing well. We're only a couple years into ActivityPub as an interchange format & growing many of the caoabilities & tools & systems, around all mimds of use cases, that will make throwong together a fair, interactabke competitive offering possoble. Social media has had huge huge investmemt poured into it, but we are in decent preteen years of growing up & owning the libre equivalents. We can assess demamd only after there is a visualizable state people can imagine; just having an isolated blog is not the equivalent to the well connected social media site, but these capabilities slowly arise. Follow the alpha geeks; this currently long phase will not be forever.

Re: Enhanced noise suppression in Jitsi Meet

#34
post #23

Sorry, but at least in my smartphone, I can understand better the unprocessed audio showcased down in the Web page, than the noise-suppresed audio. How is that?

The original audio is significantly easier to understand. This may be technically interesting, but the noise suppression is aggressive to the point that it's eating critical signal with the noise.

Re: Enhanced noise suppression in Jitsi Meet

#35
post #5

Created a few years ago by Jean-Marc Valin of xiph/mozilla (who by the way is also the author of Opus codec among other things): https://gitlab.xiph.org/xiph/rnnoise/ Overview of RNNoise from the horse's mouth is here: https://jmvalin.ca/demo/rnnoise/ Used as a Wasm module! In some ways the web is becoming more opaque. Is this the future then, a hodgepodge of binaries doing things behind the scenes? Though in this ca…

What a weird take.

How else would we have implemented this? WASM has facilitated introducing these technologies into web applications, it literally wasn’t possible before.

Thanks to emscripten it wasn’t even that hard to get rnnoise working on WASM: https://github.com/jitsi/rnnoise-wasm

I concede WASM does open the possibility of adding opaque stuff to web apps but IMHO the benefits outweigh the drawbacks at this point.

Re: Enhanced noise suppression in Jitsi Meet

#36
post #7
post #3

Very very good, a little bit of stuttering during the honking I think but I like it overall! :D :) Jitsi Meet has been a great alternative to other meeting apps in these crazy times.

My experience with Jitsi Meet has been quite bad. My previous employer was a cheapskate, and they self-hosted Jitsi Meet. Random disconnections and instability were pretty much a daily occurrence, some people were disconnected every few seconds. While I suppose the self-hosting by Cheapskate Inc. was the main culprit, Jitsi’s screen sharing wasn’t looking very good.

We’ve made significant tweaks to screen-sharing in the past 2-3 stable releases, in case you feel inclined to check us out again :-)

Re: Enhanced noise suppression in Jitsi Meet

#37
post #19
post #13

Earlier quoted context omitted.

Is this a troll comment? Yes, wasm works based on a compiled binary, just like any other program written in a compiled language in the past 50 years. You try to suggest that everyday users of the web are just going into the js sources of webpages and understand whats going on. With the plethora of libraries, frameworks and static optimization used in todays websites, normal people can't really dissect the inner worki…

They didn't suggest the web is doomed, just that more aspects of it are opaque. I don't think they're talking about every day users of the web either, but rather nascent developers. The early web was a great equalizer. Anybody could study a little html, download an ftp manager, jump through a few procedural hoops and have a web page. After some studying and trial and error they could even build an interactive site.[1…

JavaScript minifiers to obfuscate the code have been around pretty much since the language got popular, so that version of the web's been gone since about when Myspace lost to Facebook. Places like Glitch.com is trying to bring that back though.

Re: Enhanced noise suppression in Jitsi Meet

#38
post #31
post #25

Bummer, reading the title I thought Jitsi had a new de-noiser because they had RRNoise for some time. Unfortunately RRNoise has not received much advancement for a couple years. It's by now half a decade old tech. I've worked with the WASM version in the past but it can be hit or miss. Sometimes it makes the audio you want a bit weird. It also added something like 10% CPU usage and in the end we disabled it again. I'…

While we’ve had rnnoise integration for a while it was for “noisy environment” notifications, this is the first time we use it to actually filter audio. Also audio worklets weren’t a thing when we first introduced it. I’m not aware of any other open source (and better) models, but if any come up, we’ll certainly check them out!

If you have any involvement with Jigasi or might be in the know -- are there plans to use whisper, for instance, instead of Google's API for transcription? If I recall correctly jigasi is using google's API, local transcription aligns well with the rest of Jitsi's missions.

Re: Enhanced noise suppression in Jitsi Meet

#39
post #35
post #5

Created a few years ago by Jean-Marc Valin of xiph/mozilla (who by the way is also the author of Opus codec among other things): https://gitlab.xiph.org/xiph/rnnoise/ Overview of RNNoise from the horse's mouth is here: https://jmvalin.ca/demo/rnnoise/ Used as a Wasm module! In some ways the web is becoming more opaque. Is this the future then, a hodgepodge of binaries doing things behind the scenes? Though in this ca…

What a weird take. How else would we have implemented this? WASM has facilitated introducing these technologies into web applications, it literally wasn’t possible before. Thanks to emscripten it wasn’t even that hard to get rnnoise working on WASM: https://github.com/jitsi/rnnoise-wasm I concede WASM does open the possibility of adding opaque stuff to web apps but IMHO the benefits outweigh the drawbacks at this poi…

Oh no you're absolutely right, my general frustration was ill-placed for this thread. Wasm is no doubt the right and only way to have done this.

Re: Enhanced noise suppression in Jitsi Meet

#40
post #21
post #4

I’m using RNNoise as a pipewire input filter on my Linux machines, but that’s very Linux-specific and a bit “hardcore” to setup. Nice to see it getting integrated into video meeting solutions, so more people can take advantage of this awesome library.

Awesome! Could you please elaborate how to do it or post some good/not outdated links?

Don’t remember exactly which guide I followed, but I used the build from this repo, and the instructions looks plausible:

https://github.com/werman/noise-suppression-for-voice#pipewi...

Post reply on HN