Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Nightingale – open-source karaoke app that works with any song on your computer

nightingale.cafe

Post reply on HN
Print view View original

21–30 of 175 posts

Re: Nightingale – open-source karaoke app that works with any song on your computer

#21

Post by rzzzzru »

dmd wrote: post #14

This looks great, but I don't understand what it's supposed to do. I assumed the idea was "remove the lyrics" but of the 5 songs I tried (from Cry Cry Cry, Indigo Girls, and Suzanne Vega), none seemed to have any change from the original at all - it's showing the words on the screen (and the timing is perfect) but it's not removing the singing at all. How do you turn off the singing?

hey!

you can use + / - buttons on the keyboard to change the level of guidance according to your preference, generally there is a controls legend in the top right corner

https://nightingale.cafe/docs/controls

Re: Nightingale – open-source karaoke app that works with any song on your computer

#22

Post by rzzzzru »

caipira wrote: post #10

This looks amazing! looking forward to test it on the weekend. Does it work well on a raspberry pi with 4 gigs of ram?

oof, since it uses quite heavy models locally I would expect it to struggle on such hardware. M1+ macs & nvidia gpus work the best and fastest.

Re: Nightingale – open-source karaoke app that works with any song on your computer

#27

Post by dmd »

rzzzzru wrote: post #21
dmd wrote: post #14

This looks great, but I don't understand what it's supposed to do. I assumed the idea was "remove the lyrics" but of the 5 songs I tried (from Cry Cry Cry, Indigo Girls, and Suzanne Vega), none seemed to have any change from the original at all - it's showing the words on the screen (and the timing is perfect) but it's not removing the singing at all. How do you turn off the singing?

hey! you can use + / - buttons on the keyboard to change the level of guidance according to your preference, generally there is a controls legend in the top right corner https://nightingale.cafe/docs/controls

Yeah, I did that. I think the problem is when there are multiple singers harmonizing it only removes one.

Re: Nightingale – open-source karaoke app that works with any song on your computer

#28

Post by rzzzzru »

rzzzzru wrote: post #18
whilenot-dev wrote: post #9

Earlier quoted context omitted.

Just tried it with B.E.D - Walk Away [0], unfortunately it lost track of the lyrics after 30 secs (Model is "large-v3"). Will play around a bit more, as it would be great to have a working karaoke generator. Some quick feedback: - Needs a way to skip for-/backwards during playback to validate the result - Sentences seem to be recognized (first letter has uppercasing), but periods aren't added - Needs an option to edi…

hey mate! thanks for your feedback. indeed, I'm running to two problems on the analyzer side: 1. align model sliding off (especially w/ chorus/back vocals present) 2. transcript skipping parts of lyrics in lyrics-heavy tracks (I tried a lot of russian rap, lol) happy for contributions as I'm not that experienced w/ machine learning side of the project, mostly it was emperical "tweak the parameters and look what is ch…

also model only affects the transcript job (I need to make it clearer in the UI). For the alignment, it's a single model provided by whisperx

Re: Nightingale – open-source karaoke app that works with any song on your computer

#29

Post by rzzzzru »

integralid wrote: post #7

>app that works with any song on your computer Impressive, very nice. Now let's see my death metal collection. Just joking! Very nice, thanks for open-sourcing it.

No joke, feel free to try it! The beauty of the approach is that you don't have any limitations. Just be prepared to degraded experience, sometimes models struggle even with the simplest pop tracks :D

Re: Nightingale – open-source karaoke app that works with any song on your computer

#30

Post by rzzzzru »

solstice wrote: post #6
rzzzzru wrote: post #2

I've been working on a karaoke app called Nightingale. You point it at your music folder and it turns your songs into karaoke - separates vocals from instrumentals, generates word-level synced lyrics, and lets you sing with highlighted lyrics and pitch scoring. Works with video files too. Everything runs locally on your machine, nothing gets uploaded. No accounts, no subscriptions, no telemetry. It ships as a single…

Excited to try this out. How well does WhisperX deal with lyrics in say Mandarin or Cantonese? Does it output Hanzi?

I haven't tried Mandarin and Cantonese, but tried Japanese. back at that time, it performed poorly. however, I've tweaked a bunch of settings since then, so maybe it has changed. Hanzi is a supported font and can be output, but the transcript/alignment quality might not be the best
Post reply on HN