Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Spleeter: Extract voice, piano, drums, etc. from any music track

github.com

Post reply on HN
Print view View original

151–160 of 182 posts

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#151

Post by jacquesm »

alez wrote: post #150
jacquesm wrote: post #145

Earlier quoted context omitted.

So, I used it to run the same toccata test, here are the results: The Magenta code: f_measure 71.56 precision 65.75 recall 78.49 accuracy 55.72 My little batch of code: f_measure 77.74 precision 93.40 recall 66.57 accuracy 63.58 Interpreting the results is tricky, they are obviously better on 'recall' but that is at the expense of being much less precise which gives a much better result for my code; besides it is nic…

Oh wow that's extremely promising! Yeah the magenta thing destroys my browser when I run it. Still feels like magic though haha. I would be extremely interested in some other options so good luck!

Thank you! If you have any files you want me to test with then feel free to send them, email is in my profile.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#152

Post by jacquesm »

smcnally wrote: post #148
viburnum wrote: post #138

Earlier quoted context omitted.

How do you do this in Ableton?

https://www.ableton.com/en/manual/converting-audio-to-midi/ There are four options. > Convert Melody to New MIDI Track > This command identifies the pitches in monophonic audio and places them into a clip on a new MIDI track.

> This command identifies the pitches in monophonic audio and places them into a clip on a new MIDI track.

Neat. So, the big difference then is that I do fully polyphony but I'm still limited to 'just' piano but that's already hard enough for now.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#153

Post by ropable »

mwcampbell wrote: post #49

For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…

They need to link these on the project readme as a demo.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#154

Post by danso »

CamperBob2 wrote: post #133
BrentOzar wrote: post #118

Earlier quoted context omitted.

> So Jonathan Coulton is now the new Suzanne Vega? Bravo. For people who didn't get the sublime reference, Suzanne Vega's song Tom's Diner was a benchmark test during development of the MP3.[1] [1]: https://en.wikipedia.org/wiki/Tom%27s_Diner#The_"Mother_of_t...

Tom's Diner wasn't just a benchmark. Brandenburg listened to it obsessively, over and over, to the exclusion of a lot of other content he might have done well to pay more attention to. Which is what tends to happen when you work on audio processing code, for better or worse. So that's why the MP3 format mangles male vocals so badly at all but the highest bitrates. Now you know the Rest Of The Story... or at least you…

This sounds really interesting. Is there a good writeup/oral history about this?

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#155

Post by sjwright »

codedokode wrote: post #134
nickjj wrote: post #110

Earlier quoted context omitted.

That roboticness is because there's overlap in frequencies between the voice and the instruments. I have no idea how this tool splits them up at the implementation level but I imagine it tries to split it up based on frequencies and when it lifts out the voice, it's cutting out a ton of frequencies that would normally be in your voice so now it sounds very unnatural, blocky and metallic. With studio quality headphone…

I don't argue that it's a great technology, but some of the neighbour commenters wrote things like "perfect", and to me it doesn't sound like "perfect" yet. For example, in the beginning, if you listen to the phrase "from the office ...", in original recording it sounds smooth, like a single phrase (and the voice is warm and pleasant), but in the separated track it sounds like it is synthesized from pieces that are n…

It’s perfect relative to the most wildly optimistic expectations anyone could have reasonably held beforehand.

The vocals don’t have any significant residual artefacts from drum hits or any residual bleed-through of instruments playing the same notes. It’s magical.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#157

Post by ksherlock »

mothsonasloth wrote: post #72

I'm trying to find something to generate tracks without guitar. Then I can cover them with my guitar. Will this software help me?

depends? It splits it into 2 parts (vocal, everything else), 4 parts (drum, bass, vocal everything else), or 5 parts (drum, bass, vocal, piano, everything else). piano isolation is the weakest.

If you want to play along to drum + bass, then yes.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#158

Post by 8bitsrule »

mwcampbell wrote: post #49

For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…

IME, this tool is certainly an order of magnitude closer to the Holy Grail than anything I've ever heard. Kudos to Deezer R&D.

https://www.youtube.com/watch?v=KPlmrq_rAzQ

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#159

Post by viburnum »

smcnally wrote: post #148
viburnum wrote: post #138

Earlier quoted context omitted.

How do you do this in Ableton?

https://www.ableton.com/en/manual/converting-audio-to-midi/ There are four options. > Convert Melody to New MIDI Track > This command identifies the pitches in monophonic audio and places them into a clip on a new MIDI track.

Thanks so much. I thought I had read through the manual but there's all kinds of stuff I've missed.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#160

Post by _fbpt »

voicedYoda wrote: post #108
_fbpt wrote: post #55

Earlier quoted context omitted.

The SNES is a 1990s game console. Its music is generally synthesized by the SPC700 chip, from individual instruments stored in 64 kilobytes of RAM (so the instruments often sound synthetic and muffled). The advantage is that it's possible to separate out instruments. Either: - Programatically gather a list of all samples used in the song - Generate many modified .spc files, each of which mutes 1 sample via editing th…

I did come across the person who did a similar project (automating instruments based on previously recorded music), however in one project that was playing live instruments from an NES, the signals were already separated. That said, I'm not following the context of your response to my post.

You mentioned that "the biggest hold up is getting enough properly trained data, tagged appropriately, in order to let the models train correctly." I think using SNES music as training data is a viable way of getting hundreds of songs' worth of training data in a fairly automated fashion. (I'd estimate that each game has 10 to 80 songs which can be used for training, I have 5 to 10 games of OSTs already downloaded, and each song is only 64 kilobytes and takes minimal disk space before rendering to WAV.)
Post reply on HN