Live data from Hacker News

Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

dylanbeattie.net

11–20 of 39 posts

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#11
post #9

> I’ve created 5-channel mixes of all the backing tracks so we can fade out specific instruments if somebody wants to play them live How was this done? This seems like an even more difficult task to do well than what’s described in the article

Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode [0] https://www.karaoke-version.com/ [1] https://github.com/deezer/spleeter

is there an ai model that can do this at the moment?

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#12
post #11

Earlier quoted context omitted.

Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode [0] https://www.karaoke-version.com/ [1] https://github.com/deezer/spleeter

is there an ai model that can do this at the moment?

Ultimate vocal remover is a common one

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#13
post #11

Earlier quoted context omitted.

Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode [0] https://www.karaoke-version.com/ [1] https://github.com/deezer/spleeter

is there an ai model that can do this at the moment?

There's an openvino plugin for audacity that can do music separation but it only supports 4 tracks at the moment (drums, bass, vocals, other).

https://github.com/intel/openvino-plugins-ai-audacity/blob/m...

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#16
Excellent, also check out the https://alphatab.net library which would let you render guitar pro tracks for the video.

Around 2013 I built a guitar tab synced to youtube video proof of concept thing and promptly let it rot, should have done more with it!

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#18
Really good work. I like the way the author breaks down the procedures using open source tools. Nice and thanks for sharing. May I add Chord ai for someone who wants to see similar projects? It's a paid app supported by ai. Personally, it helped mre where I could not figure out the chord progressions myself. I don't know if this is off topic but I searched a while back for a tool to do a summary of research papers. I found out some and I was really flabbergasted by the progress of these tools with ai. When I graduated from uni 22 years ago, these things were only in the science action movies. Oh well...

Re: Guitar chord karaoke with Vamp, Chordino, and FFmpeg (2022)

#20
post #6
post #2

Very cool indeed! Does anyone know how it's possible for Vamp to extract guitar chords from audio? What if there are multiple guitars, like lead and bass, or lead and rhythm?

That particular algorithm doesn't care whether the instruments are guitar or otherwise. There are other algorithms in vamp that would deal with individual notes. But in terms of separating tracks, vamp doesn't do that. There are some new ML-based solutions for this though. So you could separate them and run vamp on those outputs. But to get the chords I don't think you need to worry about that.

To add to this, it’s vanishingly seldom that you would have a finished track where multiple parts of the ensemble are playing different chords, rather than each part making up the same overall chord structure.
Post reply on HN