Live data from Hacker News

Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

github.com

11–20 of 67 posts

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#11

Hopefully no DMCA of something like that affect this project, long time ago I wanted to build a lyrics translation website, but apparently you may get in trouble for using copyrighted lyrics.

The data sources come from YouTube or user-uploaded audio, and the lyrics are extracted from the audio using AI models.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#14
Well done! Worked very well for a song I tried. This is a useful tool for learning music production and theory. Downloading the generated midi file it only gave me the basic chords - that's useful but it would be awesome to get midi of all the instruments. I will definitely be exploring this further, good stuff!

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#15

wow, I remember hearing about the Cocktail mix problem a few years back and I thought it may be near to impossible to solve, this may not be quite there yet but AI progress is impressive. You can try it on their website https://lamucal.ai/

It doesn't make sense to show the progress of AI processing for featured songs which have been seen by dozens of visitors and surely are cached. Is this trick related to copyright issues?

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#18
Pretty cool! Tried it with RHCPs Dani California (https://lamucal.ai/songs/red-hot-chili-peppers/dani-californ...) and there's a lot of wrong chords still. Impressive nonetheless, and already quite useful in the song-part recognition (assuming it's all the ML)! Lyrics seem right too.

The source separation only seems to be available when downloading their app, which I didn't do, so I can't comment on that.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#19
So cool!

I just tried it with a song with a fairly complicated chord progression - yesterday by the beatles. It did pretty well! But it got a couple parts wrong.

Is there support for modifying the results of the chords/lyrics? I don't see it immediately.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#20
Well, from the PoV of someone who tries to learn how to play the guitar I must say that all this AI frenzy managed to produce some useful tools ;-)

I checked https://lamucal.ai/ with some example MP3:

- lyrics are OK (although I've seen tools that managed to do better),

- chords recognition wasn't bad,

- the UI is a bit rough around the edges (and I managed to get some Unity-related errors),

- pitch-aware speed adjustments is always a great tool when someone tries to learn how to play the song,

- transposing can be useful as well (although the web application does not support it).

I'm using (and paid for) some other similar application, although I primarily use that for tracks separation. Later I import tracks into Ardour and then record my own guitar lines. I use just a miniscule percentage features of the DAW, so if someone could provide an application with all that AI goodies coupled with recording ability that would be wonderful.

That said in personally I've found that one way or another I need to listen a lot to the song I'm trying to learn, make notes, break down the song structure (sections, strumming patterns, chords etc.). And a good video on YouTube that starts with a simple version of the song and then adds more and more feature are often the best help to start with, at least at my current level.

Post reply on HN