21–30 of 39 posts
Excellent, also check out the https://alphatab.net library which would let you render guitar pro tracks for the video. Around 2013 I built a guitar tab synced to youtube video proof of concept thing and promptly let it rot, should have done more with it!
- The Vamp Plugin Pack for Mac finally got an ARM/Intel universal build in its 2.0 release last year, so hopefully the caveat mentioned about the M1 Mac should no longer apply
- Most of the Vamp plugins in the Pack pre-date the pervasive use of deep learning in academia, and use classic AI or machine-learning methods with custom feature design and filtering/clustering/state models etc. (The associated papers can be an interesting read, because the methods are so explicitly tailored to the domain)
- Audacity as host only supports plugins that emit time labels as output - this obviously includes beats and chords, but there are other forms of analysis plugins can do if the host (e.g. Sonic Visualiser) supports them
- Besides the simple host in the Vamp SDK, there is another command-line Vamp host called Sonic Annotator (https://vamp-plugins.org/sonic-annotator/) which is even harder to use, equally poorly documented, and even more poorly maintained, but capable of some quite powerful batch analysis and supporting a wider range of audio file formats. Worth checking out if you're curious
(I'm the main author of the Vamp SDK and wrote bits of some of the plugins, so if you have other questions I may be able to help)
What a cool thread! I like how you put the specifics of your workflow and especially details of the commands you used! Particularly with the vamp commands, because as you say, they are somewhat inscrutably named/documented. I started dabbling with vamp as well a couple years ago, but lost track of the project as my goals started ballooning. Although the code is still sitting (somewhere), waiting to be resuscitated. I…
I think they were initially using the Chordino chroma features (NNLS-Chroma) but a different chord language model "front end". Their page at https://chordify.net/pages/technology-algorithm-explained/ seems to imply they've since switched to a deep learning model (not surprisingly)
One 'feature' that immediately came to mind for me is automatic transposing for use with a capo. Many hobby guitarists cannot play barre chords for an entire track, especially if they don't know it already. Transposing is already a thing for vocal karaoke and quite common. Some players may be skilled enough to transpose in their head to take advantage of the capo, but juggling the lyrics, instrument, and transposing at once is quite taxing mentally.
Cool project!
Earlier quoted context omitted.
Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode [0] https://www.karaoke-version.com/ [1] https://github.com/deezer/spleeter
is there an ai model that can do this at the moment?
Works pretty well for my personal/hobbyist use (quality also depends on genre and instruments used - synth stuff tends to bleed into voice a bit).
Earlier quoted context omitted.
Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode [0] https://www.karaoke-version.com/ [1] https://github.com/deezer/spleeter
is there an ai model that can do this at the moment?
If I recall correctly, https://vocalremover.org/ worked pretty well. Though, it's pretty limited in the free tier and only allows payment via patreon. I never tried the paid version because I don't have a patreon account and don't want one.
any dylan beattie post must be accompanied with a recommendation for his hit single, You Give REST a Bad Name https://www.youtube.com/watch?v=nSKp2StlS6s