> Spleeter is the Deezer source separation library with pretrained models
Curious, what is Deezer using this for?
Spleeter: Extract voice, piano, drums, etc. from any music track
91–100 of 182 posts
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#92Earlier quoted context omitted.
The SNES is a 1990s game console. Its music is generally synthesized by the SPC700 chip, from individual instruments stored in 64 kilobytes of RAM (so the instruments often sound synthetic and muffled). The advantage is that it's possible to separate out instruments. Either: - Programatically gather a list of all samples used in the song - Generate many modified .spc files, each of which mutes 1 sample via editing th…
I'd guess this would result in a model for separating SNES music.
I would guess Garageband tracks would be more representative of 'real' instruments than chiptunes.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#93> Spleeter is the Deezer source separation library with pretrained models Curious, what is Deezer using this for?
Gonna guess beat/mood/song analysis.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#94For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…
[deleted]
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#95For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…
Holly cow! The separation is sort of perfect! Thanks for the demo.
"Indistinguishable from magic."
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#96An interesting alternative approach for instrument sound separation is to use a fused audio + video model. So, given that you also have video of the instruments being played, you can perform this separation with higher fidelity. I was fascinated by the work done by “The Sound of Pixels” project at MIT. http://sound-of-pixels.csail.mit.edu/
That’s quite clever but not really practical : instruments heard in most music produced today aren’t "played" by humans.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#97I look forward to a day I can click a button to watch videos online without any unnecessary and distracting background music (though it would be better if there were an option and precedent to offer unornamented narrative in video players). The next step after this would be to have live 'music cancelling' headphones for the grocery store (if such a thing still exists).
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#98Has anyone tested this with Glenn Gould recordings?
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#99Somewhat of a tangent, but does anyone have a recommendation of an open source (ideally python) program that can make MIDI from piano audio?
MIDI Guitar 2 from Jam Origin (jamorigin.com) works well even for piano.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#100For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…
While it's a great technology, the result sounds somewhat robotic. On the original recording the voice sounds soft, but after separation it sounds like it is synthesized or passed through a vocoder, something is missing. The voice contains pieces of strumming sound. Guitar also sounds "blurred", as if someone cut an object from the picture and blurred the cut to make it less visible. Clap sound is distorted, on the original recording it sounds the same, but after separation it sounds different every time, as if it was filtered or compressed with low bitrate.
It is amazing how the ear manages to distinguish all the sounds without distortion.