Spleeter – Music Source-Separation Engine • Hacker News Board

Re: Spleeter – Music Source-Separation Engine

#31

Post by Guillaume86 » Tue, May 19, 2020, 8:44 AM UTC

svat wrote: post #27

I often have voice recordings with a lot of background noise (e.g. a public lecture in a room with poor acoustics, recorded from a phone in the audience — there's usually sounds of paper rustling, noises from the street, etc). Is this "source-separation" the sort of thing that could help, or does anyone have other tips? The best thing I have so far is based on this https://wiki.audacityteam.org/wiki/Sanitizing_speech…

You could give a shot to the Nvidia RTX Voice plugin if you have one of the compatible cards. I'm not sure how it deals with low background noises, the youtube reviews mostly tested it with over the top cases like a vacuum cleaner next to the speaker.

Re: Spleeter – Music Source-Separation Engine

#32

Post by FraKtus » Tue, May 19, 2020, 8:47 AM UTC

kleiba wrote: post #22

FraKtus wrote: post #18

It says it can be 100 times faster than in real-time. So can it be run in real-time? I am thinking about extracting features for music visualization but it could make a DJ happy also.

Sometimes the distinction is made between "real-time" and "online" processing. The first one refers to the speed of the processing in relation to the length of the recording - so, say, you can process a 10 minute recording in 1 minute then you're 10x real-time. However, your analysis might require the full track to be available for best outcomes, and so you cannot really start with the processing until the full sourc…

Exactly, while fast if this method needs to parse the full track before starting to generate the results then it can't be used in real-tine.

To be used with arbitrary audio in real-time, after initialization and setup you need an API that looks like:

ProcessAudio (samples, num_namples)

And it would return n packets of num_namples samples.

Re: Spleeter – Music Source-Separation Engine

#33

Post by [deleted] » Tue, May 19, 2020, 9:04 AM UTC

[deleted] wrote: post #26

[deleted]

[deleted]

Re: Spleeter – Music Source-Separation Engine

#34

Post by tsukurimashou » Tue, May 19, 2020, 9:07 AM UTC

iseanstevens wrote: post #6

There is a Max/Ableton live plugin version here, which makes it much easier to experiment with Spleeter artistically. https://github.com/diracdeltas/spleeter4max/releases/

needs a reaper version as well!

Re: Spleeter – Music Source-Separation Engine

#35

Post by antman » Tue, May 19, 2020, 9:45 AM UTC

voiper1 wrote: post #25

Very cool! I was even able to run it on their notebook https://colab.research.google.com/github/deezer/spleeter/blo... without setting anything up locally. The results of vocal separation were quite impressive.

Can you share the outputs please?

Re: Spleeter – Music Source-Separation Engine

#36

Post by Juliate » Tue, May 19, 2020, 9:57 AM UTC

roddylindsay wrote: post #23

Once this technology gets incorporated into DJ mixers / CDJs, this is going to make DJing much more creatively interesting. Historically, blending between mixed stereo tracks has limited to mixing EQ bands, but now DJs will be able to layer and mix the underlying stems themselves -- like putting the vocal from one track onto an instrumental section on another (even if there were never a capella / instrumental version…

Wouldn't it be much more efficient for everyone (and even lucrative for the owners) to also provide the studio stems at a slightly higher/different price?

(not that some of these are not already available when you know where to search, but it's not very... structured)

Re: Spleeter – Music Source-Separation Engine

#37

Post by pgt » Tue, May 19, 2020, 10:13 AM UTC

roddylindsay wrote: post #23

Once this technology gets incorporated into DJ mixers / CDJs, this is going to make DJing much more creatively interesting. Historically, blending between mixed stereo tracks has limited to mixing EQ bands, but now DJs will be able to layer and mix the underlying stems themselves -- like putting the vocal from one track onto an instrumental section on another (even if there were never a capella / instrumental version…

Disclaimer: my hobby is correcting people on the Internet when they say disclaimer but they really mean disclosure :)

Re: Spleeter – Music Source-Separation Engine

#38

Post by marksomnian » Tue, May 19, 2020, 10:15 AM UTC

Had a play with the Colab and it's quite good indeed. The authors claim "100x real time speed", which is mighty impressive, but I'd be more interested in seeing a "Try Really Hard" mode, trading off quality and speed. Is that a thing that can be done in the current code, I wonder?

Re: Spleeter – Music Source-Separation Engine

#39

Post by marksomnian » Tue, May 19, 2020, 10:16 AM UTC

Juliate wrote: post #36

roddylindsay wrote: post #23

Once this technology gets incorporated into DJ mixers / CDJs, this is going to make DJing much more creatively interesting. Historically, blending between mixed stereo tracks has limited to mixing EQ bands, but now DJs will be able to layer and mix the underlying stems themselves -- like putting the vocal from one track onto an instrumental section on another (even if there were never a capella / instrumental version…

Wouldn't it be much more efficient for everyone (and even lucrative for the owners) to also provide the studio stems at a slightly higher/different price? (not that some of these are not already available when you know where to search, but it's not very... structured)