Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

github.com

Post reply on HN
Print view View original

41–50 of 67 posts

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#41

Post by herogary »

atum47 wrote: post #36

I've always wanted to implement a FFT from scratch and play with it to separate audio waves but then a full time job came along. I guess once you separate vocals from everything else you can just feed it to a speech to text? To be completely honest, as a human that does not speak English natively, i find some lyrics hard to understand. I've seen native English speakers also having this problem. I think it's only neut…

Source separation is commonly done by applying masks to the spectrogram. Deep learning is used to train the mask masks for different instruments' parameters. As you mentioned, this is the approach we will follow in the subsequent steps.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#43

Post by luckydata »

adrianh wrote: post #30

I tried it on one of my own tunes: https://lamucal.ai/songs/adrian-holovaty/adrian-holovaty-the... The beats/chords were consistently a full beat off, and the chords were probably only 50% right. I chose this tune because (to my ears) the harmony is pretty clear. Compare this to my own manually created transcription of the same tune, and it's night-and-day difference: https://www.soundslice.com/slices/tpbwc/ Beat det…

sounds like your site could be a great training set, someone should reach out to you sounds like a good business opportunity.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#44

Post by herogary »

avallach wrote: post #42

In the Android app I consistently get "Downloading model file" stuck at exactly -60830200% . Tried clearing data and caches and changing the connection.

Thank you for your feedback. Could you please email us the information of your phone model and system version? We will investigate promptly. In the meantime, you can try exiting the program and re-entering to see if that helps. Please also check your network connection.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#48

Post by radlad »

My partner plays violin and was looking for a version of Lindsey Stirling's Crystallize without the violin part (or rather, with it turned down.)

I found plenty of tools online to do this, but they were all credit-based and a bit annoying to use. I eventually found they were mostly using Demucs from Facebook: https://github.com/facebookresearch/demucs

Really nice tool if you need simple splitting of things like drums, vocals, etc. It's not perfect, but it's a great start.

Re: Hybrid-Net: Real-time audio source separation, generate lyrics, chords, beat

#50

Post by herogary »

radlad wrote: post #48

My partner plays violin and was looking for a version of Lindsey Stirling's Crystallize without the violin part (or rather, with it turned down.) I found plenty of tools online to do this, but they were all credit-based and a bit annoying to use. I eventually found they were mostly using Demucs from Facebook: https://github.com/facebookresearch/demucs Really nice tool if you need simple splitting of things like drums…

Yes, the Demucs mixing model has excellent SNR performance, but it is computationally intensive. It also incorporates a random mechanism, so each time it produces different spectrograms.
Post reply on HN