I've always wanted a way to extract just the kick drums in realtime but I don't understand this field well enough to understand whether it would be remotely possible or not.
StemRoller – Isolate vocals, drums, bass, and other stems from any song
71–80 of 102 posts
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#72Is there a way to process my own audio file rather than choosing one from YouTube?
A couple of commenters have mentioned using lossless files, but so far no one has said HOW.
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#73Not to be dismissive, but as far as I can tell, the heavy work is done by facebook's demucs and this is an electron front end to run the demucs cli (and I guess search youtube for videos to download). The demucs project page has more information. https://github.com/facebookresearch/demucs
Original Demucs author here. Thanks for putting forward our research! I’m definitely happy to see more front ends for Demucs being developed and to read that it has been useful to other musicians! We are working on the next iteration of the model, and with more sources, hopefully released by the end of the year :) If you are interested in this research you can follow my Twitter (@honualx) or star the Demucs repo.
Is there something similar for separating different voices from spoken audio?
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#74Tried splitting a complex arrangement (Chicago by Sufjan Stevens). Drums bass and vocals come out fairly well, though the drums stem seems to lack other percussion elements outside of the core rock drumkit (e.g. tamborine), and cymbals hits are clipped rather than ringing. The 'other' stem, the rest of the instrumentation, keeps a fair bit of the percussion and there's bleed from the vocal melody. The backing vocals…
Did you use a FLAC/WAV file? That should yield the best results. (Only asking because you linked to YouTube, and I'm not sure if you used the YouTube audio for your source.)
Makes sense. MP3 tries to compress without loosing information in the hearable spectrum of a human but that information can still be processed by algorithms.
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#75How do you load a local file?
There is no support for a such thing, this is software in year 2022, never local, online first.
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#76Honestly, this sort of thing is cool; but why (in general) is it necessary in the first place? If the elements of the song are recording in isolation - which they are in all studio versions, why can't we just move to a format that supports the layering?
I usually use this kind of tools to get the bass score of some songs, for example. With the isolated elements it is much easier to know exactly what notes are sounding (I don't have a good ear). The same for drums or synth notes.
As after all the sound quality doesn't interest me too much to do this, I usually use iZotope RX, but I will try this tool.
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#77Is there a way to process my own audio file rather than choosing one from YouTube?
A couple of commenters have mentioned using lossless files, but so far no one has said HOW.
Maybe use demucs directly?
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#78For all who look for something like this, iZotope RX (the audio retouche software) has a function called "Musical Rebalance" which is great for reducing spill or changing the balance in a live recording.
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#79Earlier quoted context omitted.
Original Demucs author here. Thanks for putting forward our research! I’m definitely happy to see more front ends for Demucs being developed and to read that it has been useful to other musicians! We are working on the next iteration of the model, and with more sources, hopefully released by the end of the year :) If you are interested in this research you can follow my Twitter (@honualx) or star the Demucs repo.
I'm curious, what is the business justification for funding development of Demucs, if you don't mind me asking? It doesn't seem very related to FB's core business.
The goal of Meta AI Research is to do open research, not necessarily with direct applications at the time we start it. Indeed, the architecture, or the lessons learnt working on it can become useful later for the company, for instance for remote presence with VR, to isolate the main speaker from its environnement ( https://arxiv.org/pdf/2206.15423.pdf ).
Re: StemRoller – Isolate vocals, drums, bass, and other stems from any song
#80Earlier quoted context omitted.
Original Demucs author here. Thanks for putting forward our research! I’m definitely happy to see more front ends for Demucs being developed and to read that it has been useful to other musicians! We are working on the next iteration of the model, and with more sources, hopefully released by the end of the year :) If you are interested in this research you can follow my Twitter (@honualx) or star the Demucs repo.
Is there something similar for separating different voices from spoken audio?
Yes there are, you can have a look at https://github.com/etzinis/sudo_rm_rf for instance for 2 speakers separation. There is also this one for 3 speakers: https://huggingface.co/speechbrain/sepformer-whamr