51–60 of 68 posts
Very cool! I was even able to run it on their notebook https://colab.research.google.com/github/deezer/spleeter/blo... without setting anything up locally. The results of vocal separation were quite impressive.
Can you share the outputs please?
Once this technology gets incorporated into DJ mixers / CDJs, this is going to make DJing much more creatively interesting. Historically, blending between mixed stereo tracks has limited to mixing EQ bands, but now DJs will be able to layer and mix the underlying stems themselves -- like putting the vocal from one track onto an instrumental section on another (even if there were never a capella / instrumental version…
Disclaimer: my hobby is correcting people on the Internet when they say disclaimer but they really mean disclosure :)
I often have voice recordings with a lot of background noise (e.g. a public lecture in a room with poor acoustics, recorded from a phone in the audience — there's usually sounds of paper rustling, noises from the street, etc). Is this "source-separation" the sort of thing that could help, or does anyone have other tips? The best thing I have so far is based on this https://wiki.audacityteam.org/wiki/Sanitizing_speech…
Sorry it's not something you can use now, but I just thought I would mention it! I also did a quick Google search but unfortunately I couldn't find any AI noise removal tools that might solve this problem.
Another recent open source contender for source separation is Open Unmix: https://github.com/sigsep/open-unmix-pytorch/ I’ve not had time to try it yet but have read good things.
I often have voice recordings with a lot of background noise (e.g. a public lecture in a room with poor acoustics, recorded from a phone in the audience — there's usually sounds of paper rustling, noises from the street, etc). Is this "source-separation" the sort of thing that could help, or does anyone have other tips? The best thing I have so far is based on this https://wiki.audacityteam.org/wiki/Sanitizing_speech…
You could give a shot to the Nvidia RTX Voice plugin if you have one of the compatible cards. I'm not sure how it deals with low background noises, the youtube reviews mostly tested it with over the top cases like a vacuum cleaner next to the speaker.
I often have voice recordings with a lot of background noise (e.g. a public lecture in a room with poor acoustics, recorded from a phone in the audience — there's usually sounds of paper rustling, noises from the street, etc). Is this "source-separation" the sort of thing that could help, or does anyone have other tips? The best thing I have so far is based on this https://wiki.audacityteam.org/wiki/Sanitizing_speech…
https://krisp.ai uses machine learning to remove background noise. I've used them with Zoom calls and it works really well. I think they don't currently have an "upload audio" feature for existing recordings, but it would be awesome if they offered this in the future. Sorry it's not something you can use now, but I just thought I would mention it! I also did a quick Google search but unfortunately I couldn't find any…
It says it can be 100 times faster than in real-time. So can it be run in real-time? I am thinking about extracting features for music visualization but it could make a DJ happy also.
created an max for live native version of spleeter and demos it here:
https://www.youtube.com/watch?v=4pcJoI5CUOA&feature=youtu.be
It's way faster than real time, im not sure why slowing it down would be an advantage. You still need to take the resultant data and do things with them, as a dj, and faster is better.
Once this technology gets incorporated into DJ mixers / CDJs, this is going to make DJing much more creatively interesting. Historically, blending between mixed stereo tracks has limited to mixing EQ bands, but now DJs will be able to layer and mix the underlying stems themselves -- like putting the vocal from one track onto an instrumental section on another (even if there were never a capella / instrumental version…
Wouldn't it be much more efficient for everyone (and even lucrative for the owners) to also provide the studio stems at a slightly higher/different price? (not that some of these are not already available when you know where to search, but it's not very... structured)
For anyone who wants to try Spleeter in a version that "just works" without having to install TensorFlow and mess with offline processing, Spleeter has been been built into a wave editor called Acoustica from Acon Digital. It's been working really well for me, and the whole package is solid competition to editors like iZotope RX: https://acondigital.com/products/acoustica-audio-editor/
I emailed them requesting more info on how their implementation works. I think this might be a violation of the MIT license?
Out of interest, and to put this in context - your brain can only do this for conversation, not music. You routinely suppress background noise and room acoustics when listening to someone speaking. But you don't do the same thing when listening to music. At best you can focus on individual elements in a track, and you can parse them musically (and maybe lyrically). But you don't suppress the rest to the point where y…
To somebody with APD, it sounds like science fiction, although it does require more suspension of disbelief than faster than light travel or teleportation.