Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Spleeter: Extract voice, piano, drums, etc. from any music track

github.com

Post reply on HN
Print view View original

61–70 of 182 posts

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#61

Post by unlinked_dll »

semiotagonal wrote: post #16
tomrod wrote: post #13

Earlier quoted context omitted.

I gave it a test using the project audio sample. Neat stuff. https://soundcloud.com/thomas-roderick-836298141/sets/spleet...

Holy shit that works way better than I expected. The github project should link to this or a similar example, the technical description doesn't do it justice.

I really disagree. It sounds... awful. On par with other approaches, sure, but the main vocals sounds like a case study in digital artifacts and the accompaniment sounds like there's a filter automated over the track.

Far from useful.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#62

Post by dspig »

Intermernet wrote: post #37

I'd love to see how this compares with Celemony Melodyne. As far as I've been able to determine, Melodyne doesn't use ML, but it's hard to find out exactly what it does use. Either way, an open source competitor to Melodyne is a welcome addition!

There is a patent for Melodyne that describes looking for harmonics vs time in FFTs, then heuristics for deciding which belong to one note and where it starts and ends, then assigning some of the resudual energy (e.g. noisy onset) to each note.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#64

Post by M4v3R »

mwcampbell wrote: post #49

For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…

Wow, I've listened to several attempts at this over the years, but this one is waaay better than anything I've heard. It's almost perfect.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#65

Post by ssttoo »

iagooar wrote: post #63

Does it work with spoken word as well? My use case: improve podcast quality by extracting the vocals only, and leaving out all background and accidental noise.

Not free nor open source but you can try a plugin called izotope Rx for this purpose

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#68

Post by mushishi »

ehnto wrote: post #54
beachy wrote: post #39

Earlier quoted context omitted.

Rick says in one of his videos that he and some of his buddies have got old copies of the original source (separated) tracks, and they kind of pass them around between each other. I find that pretty amazing given the litigiousness of some in the music industry, but there we are. Side note: I discovered Rick Beato a few months ago and I've watched heaps of his videos. It's really fascinating hearing old classics torn…

Rick Beato is excellent. Nahre Sol and Adam Neely also do great analyses of things. Adam in a more theory oriented way and Nahre in a more feeling and composition focussed way; "Funk as digested by a classical musician" for example looks at funk to try and find the key structures of the style which illuminates things I might not have noticed otherwise.

Also 8 bit music theory has very solid video essays on varying compositional concepts that are reflected using game music. I actually find his work most consistently satisfying. Neely and Beato are great but lower s/n ratio. Nahre not enough watches to say but thumbs up for her, too.

Don't forget JazzDuets's channel. His content seems to be most mature and uses actual playing a lot to tune your ear. I find him actually a bit too advanced for my level but I like a lot his very humble and friendly personal touch.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#69

Post by crucialfelix »

Intermernet wrote: post #36
taxidump wrote: post #32

Earlier quoted context omitted.

To add there is a format of music called Stems designed for DJ's and live remixers from Native Instruments which is a disassembly of the song into it's various parts. https://www.native-instruments.com/en/specials/stems/

FYI The term "stems" to refer to the individual tracks of a piece of recorded music is a lot older than NI's format. I love NI, but I'm annoyed that they chose to appropriate the industry standard term as a proprietary product. https://en.wikipedia.org/wiki/Stem_mixing_and_mastering

They published it as an open standard. Many apps and stores support it. The purpose was to take an informal industry practice and make it into a formal portable open standard.

https://www.stems-music.com/

Post reply on HN