Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Improved freemusicdemixer – AI music demixing in the browser

freemusicdemixer.com

Post reply on HN
Print view View original

11–20 of 42 posts

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#11

Post by sevagh »

fdgjgbdfhgb wrote: post #9
sevagh wrote: post #4

Earlier quoted context omitted.

In my first post, quite a lot of alternatives were discussed: https://news.ycombinator.com/item?id=36707877 The model I'm using is called Open-Unmix ( https://github.com/sigsep/open-unmix-pytorch ). In 2021, there was an update to Open-Unmix to include new weights, UMX-L, which made it perform better than it used to on the older weights (UMXHQ). In the grand landscape of music demixing, I don't think UMX-L is near th…

It's super exciting to see people using open-unmix like this! I worked with the creator of the model to try to do the same as a university project! Our solution was... not great, to say the least, but I'm happy someone else managed to do it!

That's awesome! I first got in contact with Fabien-Robert (https://github.com/faroit) during the Music Demixing Challenge 2021, where the UMX-L weights were first unveiled.

We have since discussed my projects a couple of times! I even got the idea for a streaming LSTM from him.

I think music demixing in general owes a lot of thanks to Open-Unmix and co (https://github.com/sigsep), who have relentlessly been publishing open-source models and related code (source separation metrics, dataset loaders, etc.) for years, and who blew the industry open with their MDX 21 [1] and SDX 23 [2] AI challenges.

[1]: https://www.aicrowd.com/challenges/music-demixing-challenge-...

[2]: https://www.aicrowd.com/challenges/sound-demixing-challenge-...

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#12

Post by sevagh »

Maybe I can ask HN out loud how I can start figuring out how to get this website on Google search results -

e.g. I want it to show up when I search relevant terms like "free stem separation" "free music separation" "free music isolation" "music stem separation" "music source separation"

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#14

Post by sevagh »

phpnode wrote: post #13

Just tried this and it seems to get stuck at the following step (for 20 mins so far) [WASM/C++ 18:07:24] Getting waveforms from istft [WASM/C++ 18:07:25] Copying waveforms

Hmm - that should be the end of it, at which point download links will appear to either the Single or Batch apps, depending on which one you used:

- bass, drums, vocals, other, karaoke.wav in the Single track window (at the bottom: Demixing outputs...)

- song_1.zip, song_2.zip, ... in the Batch window (at the bottom: Batch outputs...)

Like so: ``` Demixing outputs... bass.wav drums.wav other.wav vocals.wav karaoke.wav ```

There should also be a Javascript message on the left like "Preparing zip" or "Preparing stems for download"

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#15

Post by phpnode »

sevagh wrote: post #14
phpnode wrote: post #13

Just tried this and it seems to get stuck at the following step (for 20 mins so far) [WASM/C++ 18:07:24] Getting waveforms from istft [WASM/C++ 18:07:25] Copying waveforms

Hmm - that should be the end of it, at which point download links will appear to either the Single or Batch apps, depending on which one you used: - bass, drums, vocals, other, karaoke.wav in the Single track window (at the bottom: Demixing outputs...) - song_1.zip, song_2.zip, ... in the Batch window (at the bottom: Batch outputs...) Like so: ``` Demixing outputs... bass.wav drums.wav other.wav vocals.wav karaoke.wa…

ah out of memory, I'll try with a shorter track.

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#16

Post by input_sh »

alok-g wrote: post #6

For those interested, Facebook's Demucs page ( https://github.com/facebookresearch/demucs ) gives performance comparison for several models including open-unmix. See also: https://www.stemroller.com This runs as a local app on Windows and Mac.

By my own little comparison in which I've given the same song to both, Demucs appears much better (while requiring an app and consuming far more CPU).

Thanks for sharing! I had no idea this was a thing.

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#17

Post by sevagh »

phpnode wrote: post #15
sevagh wrote: post #14

Earlier quoted context omitted.

Hmm - that should be the end of it, at which point download links will appear to either the Single or Batch apps, depending on which one you used: - bass, drums, vocals, other, karaoke.wav in the Single track window (at the bottom: Demixing outputs...) - song_1.zip, song_2.zip, ... in the Batch window (at the bottom: Batch outputs...) Like so: ``` Demixing outputs... bass.wav drums.wav other.wav vocals.wav karaoke.wa…

ah out of memory, I'll try with a shorter track.

Oh no! Can you open a github issue with the size of track you tested? Or email the track to me at sevagh@protonmail.com

I can make the segment size smaller (right now I'm using 60s segments).

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#18

Post by [deleted] »

input_sh wrote: post #16
alok-g wrote: post #6

For those interested, Facebook's Demucs page ( https://github.com/facebookresearch/demucs ) gives performance comparison for several models including open-unmix. See also: https://www.stemroller.com This runs as a local app on Windows and Mac.

By my own little comparison in which I've given the same song to both, Demucs appears much better (while requiring an app and consuming far more CPU). Thanks for sharing! I had no idea this was a thing.

[deleted]

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#19

Post by adzm »

input_sh wrote: post #16
alok-g wrote: post #6

For those interested, Facebook's Demucs page ( https://github.com/facebookresearch/demucs ) gives performance comparison for several models including open-unmix. See also: https://www.stemroller.com This runs as a local app on Windows and Mac.

By my own little comparison in which I've given the same song to both, Demucs appears much better (while requiring an app and consuming far more CPU). Thanks for sharing! I had no idea this was a thing.

demucs works far better than anything else I've used, especially with more esoteric kinds of music in my experience. plus you can run it with GPU support as well!

Re: Show HN: Improved freemusicdemixer – AI music demixing in the browser

#20

Post by catapart »

Man, this is fucking awesome. Thank you for building this!

Not just free, but local, without installation, and generalized to common use-cases too? This is a standard of development that I aspire to, so thank you for being a great example!

Dev appreciation aside, I also record music with my long-distance buddy, so we often find ourselves trying to use midi recreations in order to get at least a passable version of timing and range that we can both practice from until the demo compositions have been laid down. It's often pretty far off the mark from the original track, so we will make fantastic use of this utility. Again, thanks so much!

Post reply on HN