How could we extract anything but the voice e.g. karaoke?
Spleeter: Extract voice, piano, drums, etc. from any music track
71–80 of 182 posts
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#72I'm trying to find something to generate tracks without guitar. Then I can cover them with my guitar. Will this software help me?
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#73Is there a known approach that attempts to separate all distinct sounds (timbres rather than pitch) in a track? Specifically targeted at electronic music, not standard acoustic ensembles.
That's an interesting idea. Many instruments have greatly varying timbres, though. Combining the timbres back to instruments would require another level of processing.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#74How could we extract anything but the voice e.g. karaoke?
I'd guess extract the voice and then subtract it from the rest with something like Audacity. I'm not sure which operation would do that, but I believe that it exists.
Also, other comments here speak of “separating into the voice and accompaniment,” so maybe the model/program already do exactly what you need.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#75Earlier quoted context omitted.
FYI The term "stems" to refer to the individual tracks of a piece of recorded music is a lot older than NI's format. I love NI, but I'm annoyed that they chose to appropriate the industry standard term as a proprietary product. https://en.wikipedia.org/wiki/Stem_mixing_and_mastering
They published it as an open standard. Many apps and stores support it. The purpose was to take an informal industry practice and make it into a formal portable open standard. https://www.stems-music.com/
This is better than I originally thought, but it's still a bit confusing. The Stems file spec (available via registration) is basically an MP4 container with some JSON metadata. This seems to have the usual donwsides of MP4 patents, but it's actually about as good as any standard a pro audio software company has released.
Ideally, I'd have liked to have seen a completely open audio codec used for both encoding and container, but MP4 is a pretty safe bet for compatibility , and it's not really NI's fault that it has some patent issues.
All in all, I could pedantically argue the "open" status, but I'll instead give credit where it's due, and give kudos to NI for releasing a pretty damn usable file format.
I'm even happy that it's limited to 4 parts. For the purposes of live performance with DJ style gear, this is plenty. If a performer wants more parts then they're probably going to be creating some or all of those parts. Either way, they'll probably be using something more like Ableton rather than Traktor.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#76I gave a talk at pycon this year about dsp [1], specifically some of the complexities surrounding this. I came across a few other ml projects that claimed to do this as well, and the biggest hold up is getting enough properly trained data, tagged appropriately, in order to let the models train correctly. in the git repo of this project they also explicitly state you need to train on your own data set, though you can…
The SNES is a 1990s game console. Its music is generally synthesized by the SPC700 chip, from individual instruments stored in 64 kilobytes of RAM (so the instruments often sound synthetic and muffled). The advantage is that it's possible to separate out instruments. Either: - Programatically gather a list of all samples used in the song - Generate many modified .spc files, each of which mutes 1 sample via editing th…
I'd guess this would result in a model for separating SNES music.
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#77Well, can it extract the bass track from "And the justice for all"?
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#78Earlier quoted context omitted.
FYI The term "stems" to refer to the individual tracks of a piece of recorded music is a lot older than NI's format. I love NI, but I'm annoyed that they chose to appropriate the industry standard term as a proprietary product. https://en.wikipedia.org/wiki/Stem_mixing_and_mastering
idk anyone who uses this as a proprietary format. "stems" is an industry standard term.
As discussed elsewhere in this thread, it's not as I suggested, a proprietary format. It's still a format created by NI which appropriates the industry standard name. For a list of parties using NI's implementation of the file format see https://www.stems-music.com/stems-partners/ .
I'm happier that it's a (mostly) open standard, but I'm still slightly annoyed at the confusion that comes from NI appropriating the industry term. It's like if I released a non-text representation of storing data using a particular subset of technology that was standardized, and then called it "The Binary" format. Technically nothing wrong with it, but it's bound to cause confusion!
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#79Non-open source products that also separate vocals from music if you need something more "professional".
One-click process: Xtrax Stems 2 (https://audionamix.com/technology/xtrax-stems/)
Professional: ADX Trax Pro 3 (https://audionamix.com/technology/adx-trax-pro/)
Both products use a server which have a much larger pre-trained models. The professional one has added features such as handling sibilance, GUI to edit note following as a guide for the models, and an editor tool for extracting using harmonics.
(Note: I don't work for this company. I do pay for / use their products, and I also happen to know someone who works there.)
Re: Spleeter: Extract voice, piano, drums, etc. from any music track
#80Somewhat of a tangent, but does anyone have a recommendation of an open source (ideally python) program that can make MIDI from piano audio?
There is probably something out there, but I know you can do this in Ableton Live by dragging an audio file onto a MIDI track and it will extract the notes into MIDI for you.