Cool project, but it's not very accurate. I wouldn't charge for this yet
Thank you for providing feedback. We will continue to optimize and improve the model.
Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
51–60 of 67 posts
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#52My partner plays violin and was looking for a version of Lindsey Stirling's Crystallize without the violin part (or rather, with it turned down.) I found plenty of tools online to do this, but they were all credit-based and a bit annoying to use. I eventually found they were mostly using Demucs from Facebook: https://github.com/facebookresearch/demucs Really nice tool if you need simple splitting of things like drums…
You can run Demucs directly in your browser (through WASM) on my website: https://freemusicdemixer.com/
No usage credits or cost, since it's all on your computer.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#53I would think that by comparison to image models synthetic data would be relatively easy to generate for audio model training. I’m curious then why it continues to be so difficult to build a nearly flawless audio separation model. Is synthetic data being widely used? Is it just too hard of a problem to train even with this data? I don’t have a good sense of what the most challenging aspects are of audio models.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#54[deleted]
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#55I would think that by comparison to image models synthetic data would be relatively easy to generate for audio model training. I’m curious then why it continues to be so difficult to build a nearly flawless audio separation model. Is synthetic data being widely used? Is it just too hard of a problem to train even with this data? I don’t have a good sense of what the most challenging aspects are of audio models.
Unlike images, audio signals are time-dependent and have complex temporal dynamics, making it more challenging to generate realistic synthetic data that captures the nuances of real-world audio. Meanwhile, the complex nature of audio signals, the scarcity of high-quality training data, and the subjective evaluation of audio quality collectively contribute to the ongoing challenges in building near-flawless audio separation models.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#56Am I missing something? What license is this released under?
No license, so the default "all rights reserved" applies. Can't really be used for anything.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#57It doesn't seem very well pleased with The Dance of Eternity by Dream Theater. But it was quite impressive in some aspects with the likes of Nirvana.
Future music students are going to be fortunate to have these kinds of tool. An instant split and full analysis of any song. Remixes and backing tracks on tap, etc.
That said, we older students learned a lot from the process of doing this manually ourselves. Those lessons can still be learned and others besides, but the dynamics of the learning change with the tech.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#58Finally, a new development in lyric transcription! I’ve been waiting to see this for ages!
def get_lyrics(waveform, sr, cfg): # asr and wav2vec2 raise NotImplementedError()
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#59Well, from the PoV of someone who tries to learn how to play the guitar I must say that all this AI frenzy managed to produce some useful tools ;-) I checked https://lamucal.ai/ with some example MP3: - lyrics are OK (although I've seen tools that managed to do better), - chords recognition wasn't bad, - the UI is a bit rough around the edges (and I managed to get some Unity-related errors), - pitch-aware speed adjus…
I found the lyric alignment quite good for the rap song I tested. What tool has better lyrics alignment?
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#60I see a lot of “7M” chords in generated outputs, which isn’t a type of chord I’m familiar with. Is this meant to be “M7” (major 7)?
Yes, it's a major 7th chord.
Minor 7: m7, min7 or mi7.
Major 7: M7, Maj7 or Ma7,
Guitar chords are totally whacked. Get a guitarist to help you out with those.
m7 and M7 are a reasonable choice, although min7/Maj7, or mi7/Ma7 are also good too (the pairs should match).
It shows G7 as 12ooo3, which is not how a guitarist would ever play that chord. (32ooo1, or 323oo3 of 353433, in increasing order of difficulty would be correct). Other chords have similar problems. e.g. C7 o3231o should be x3231o).