Cool project, but it's not very accurate. I wouldn't charge for this yet
Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
31–40 of 67 posts
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#32I tried it on one of my own tunes: https://lamucal.ai/songs/adrian-holovaty/adrian-holovaty-the... The beats/chords were consistently a full beat off, and the chords were probably only 50% right. I chose this tune because (to my ears) the harmony is pretty clear. Compare this to my own manually created transcription of the same tune, and it's night-and-day difference: https://www.soundslice.com/slices/tpbwc/ Beat det…
Thanks for your feedback. We're currently in the process of adjusting our dataset and model to address issues with chords and rhythm. We're looking forward to providing you with a better experience in the future.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#33Tried it on a couple of my wife’s songs and she said it was quite inaccurate in terms of chords and tabs (the lyrics were pretty close though). This seems like one of those use cases where it’s not particularly useful until it gets above some minimum accuracy threshold.
Thanks for sharing your experience. We appreciate the feedback. It's clear that improving accuracy, especially with chords and tabs, is a priority for us. We're committed to enhancing the accuracy of our tool to meet your expectations and provide a more valuable experience.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#34I tried a few songs and uploaded one of my favorite songs. The lyrics recognition result was excellent, but there were a few instances where some words were missing or incorrect. It would be great if there could be an option to edit the lyrics.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#35Tried it on a couple of my wife’s songs and she said it was quite inaccurate in terms of chords and tabs (the lyrics were pretty close though). This seems like one of those use cases where it’s not particularly useful until it gets above some minimum accuracy threshold.
At this point, I'm conflicted. The lyrics testing went well for me, but I'm not proficient in chords. Are the chord results really that poor? I wonder if I can use it to play my favorite songs in real life.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#36I've always wanted to implement a FFT from scratch and play with it to separate audio waves but then a full time job came along. I guess once you separate vocals from everything else you can just feed it to a speech to text?
To be completely honest, as a human that does not speak English natively, i find some lyrics hard to understand. I've seen native English speakers also having this problem. I think it's only neutral for a NN to do the same mistakes.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#37I tried a few songs and uploaded one of my favorite songs. The lyrics recognition result was excellent, but there were a few instances where some words were missing or incorrect. It would be great if there could be an option to edit the lyrics.
We are in the process of adding the lyrics editing feature, as well as chord and rhythm types. It will be released soon.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#38I tried the open source one that Spotify published a while ago on jazz trio music (just piano, double bass and drums) but it was pretty useless. My experiments with the trials of some commercial services, where you select an instrument and it extracts just that were much better. If the piano is a Rhodes then extracting electric guitar works well, extracting a piano not at all.
The testing model for guitar separation is currently under development. The test results are somewhat unsatisfactory due to the significant variations in guitar instrument tones, especially for electric guitars. This adds to the difficulty of training
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#39Well, from the PoV of someone who tries to learn how to play the guitar I must say that all this AI frenzy managed to produce some useful tools ;-) I checked https://lamucal.ai/ with some example MP3: - lyrics are OK (although I've seen tools that managed to do better), - chords recognition wasn't bad, - the UI is a bit rough around the edges (and I managed to get some Unity-related errors), - pitch-aware speed adjus…
Thank you for raising the issue. We are continuously optimizing our model, and we are also constantly gathering various UI and business-related bugs. We will continue to optimize and resolve them in the future.
Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat
#40Tried it on a couple of my wife’s songs and she said it was quite inaccurate in terms of chords and tabs (the lyrics were pretty close though). This seems like one of those use cases where it’s not particularly useful until it gets above some minimum accuracy threshold.
At this point, I'm conflicted. The lyrics testing went well for me, but I'm not proficient in chords. Are the chord results really that poor? I wonder if I can use it to play my favorite songs in real life.
I play guitar/piano, and I concur that they’re not great. I tried “Vagabond (acoustic)” by Wolfmother. I figured it would have an easier time because it’s just a vocal and an acoustic guitar. Some of the notes in the tabs are right, but the melody is too simplistic. All of the embellishments are also missing. It’s interesting how the mile-high view isn’t so bad though. If I sat down to figure out the notes for a track no tabs exist for, this might look like a rough approximation of what I’d start with.