I have a large number of multitrack recordings of contra dances if anyone wants to try training this on them.
You train this on them! (And then put the results on SoundCloud or YouTube.)
Spleeter: Extract voice, piano, drums, etc. from any music track
21–30 of 182 posts
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#22Wait the implications of this are huge for electronic music DJs
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#23Is there anything like this for images? Meaning essentially trying to decompose back into photoshop layers. Wouldn't be feasible for lots of stuff that is completely opaquely covering something, but I'm thinking for things like recoloring a screen print, etc.
I have no idea how I managed to re-find these, but I did. Two recent moderately-related/relevant posts:
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#24Wait the implications of this are huge for electronic music DJs
The audio (^F soundcloud) sounds a little warbly... if that can be largely mitigated, then yes, remixes will never be the same
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#25I gave a talk at pycon this year about dsp [1], specifically some of the complexities surrounding this. I came across a few other ml projects that claimed to do this as well, and the biggest hold up is getting enough properly trained data, tagged appropriately, in order to let the models train correctly. in the git repo of this project they also explicitly state you need to train on your own data set, though you can…
I'm sure you've thought of this, but could/have the tracks from the Rock Band games be used for training?
There are thousands of them and they're separated into different instrument tracks. They even had bands re-record songs sometimes where seperate masters couldn't be found. If I recall correctly, Third Eye Blind did this for Semi-Charmed Life.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#26Wait the implications of this are huge for electronic music DJs
The audio (^F soundcloud) sounds a little warbly... if that can be largely mitigated, then yes, remixes will never be the same
While not great, the phase smearing is orders of magnitude better than most vocal isolation plugins I've used. I only expect it to get better. Very cool!
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#27Karaoke with the most obscure songs!
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#28Not only are the results good, but the music is generated decently rapidly. The implications are clear: whoever wants to make a quick fortune on YouTube should start converting and uploading truckloads of songs as fast as possible. The demand is there. I could easily see that bringing in millions of views.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#29Karaoke with the most obscure songs!
And even better, karaoke that doesn't suck--most karaoke tracks are covers by cheap bands and you can clearly tell the inferior quality if you're familiar with the song.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#30I wonder how it would fare on Pink Floyd's "Sheep", where vocals seamlessly transform into instrumentals and it's impossible to tell where one ends and the other begins. https://www.youtube.com/watch?v=3-oJt_5JvV4 (skip to around 1:40)