Live data from Hacker News

Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

github.com

61–67 of 67 posts

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#61

It doesn't seem very well pleased with The Dance of Eternity by Dream Theater. But it was quite impressive in some aspects with the likes of Nirvana. Future music students are going to be fortunate to have these kinds of tool. An instant split and full analysis of any song. Remixes and backing tracks on tap, etc. That said, we older students learned a lot from the process of doing this manually ourselves. Those lesso…

Yes, let’s throw probably the most intricate progressive metal composition with over 100 time signature changes at it. I like the ambition! I tried it with “Glory” by John Legend and Common, which is literally 5 chords in C major scale and it stumbled. It identified (most of) the chords correctly but missed a bunch of them and the timing was off. It is pretty impressive anyway.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#62
post #21

LOL https://lamucal.ai/songs/john-coltrane/john-coltrane-giant-s... It's definitely on to something. I wonder how would it perform if it was trained on Jazz.

All Blues: results are unsalvageable. Wrong all the way through.

Sort of random G7 and C chords, with C / Eb7 in the turnaround.

Should either be G7 all the way through (on the lead sheet) to the turnaround which is

   D7+9 | / |  Eb7#9 | D7#9 | G7 | / / D7#9 |
Pretty safe bet that no AI will be able to do G7. But it should at least do:

|: G7 / C | Dm7 / C :] &c.

I'm guessing it isn't going to do anything past a 7 chord, so C7#9 is probably not going to happen. Which probably makes it unusable for jazz. :-(

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#64
I tried something similar last week [https://guitar2tabs.klang.io], so I just ran yours with the same song [Surfin St. Helens by The Volcanos] to see how they compared.

* Lamucal did better on the chords--to my ear they're not perfect [e.g. D vs. D minor], but guitar2tabs couldn't do chords at all. * Guitar2tabs did pretty well at figuring out the melody; they couldn't grok the rhythm, but got a pretty decent sequence of notes. Lamucal didn't even try; the "tab" is just a list of chords.

One very nice feature of guitar2tabs is that you can play either the original audio or the extracted music, so you can hear how close it is. I'd recommend adding that--just playing the original is still useful, to see they sync with the extracted music, but playing the extraction is more so.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#66
post #30

I tried it on one of my own tunes: https://lamucal.ai/songs/adrian-holovaty/adrian-holovaty-the... The beats/chords were consistently a full beat off, and the chords were probably only 50% right. I chose this tune because (to my ears) the harmony is pretty clear. Compare this to my own manually created transcription of the same tune, and it's night-and-day difference: https://www.soundslice.com/slices/tpbwc/ Beat det…

Adrian, I made a Google Colab notebook to try a different beat detection algorithm with your tune. The results sound pretty good to me!

You can listen here:

https://colab.research.google.com/drive/1Pqgc9s-nBKxU_3Ap6K0...

Post reply on HN