Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Spleeter: Extract voice, piano, drums, etc. from any music track

github.com

Post reply on HN
Print view View original

121–130 of 182 posts

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#121

Post by zzzeek »

codedokode wrote: post #100
mwcampbell wrote: post #49

For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…

While it's a great technology, the result sounds somewhat robotic. On the original recording the voice sounds soft, but after separation it sounds like it is synthesized or passed through a vocoder, something is missing. The voice contains pieces of strumming sound. Guitar also sounds "blurred", as if someone cut an object from the picture and blurred the cut to make it less visible. Clap sound is distorted, on the o…

this is like someone just flew you to the surface of Mars in an hour and your only comment is that the ride was bumpy. The demo above is mind blowing.

I basically want to run this over every Steve Gadd recording I have.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#124

Post by hodder »

Very cool. A close friend of mine (and lead singer in our band May years ago) recently died and we have a couple great recordings from 2 decades ago of his vocals. When we recorded the rest of the instruments they were DI into a Boss BR8. The lyrics sound awesome but the guitar and drums are recorded poorly. This may give us a chance to split the vocals out of the final tracks, and re-record the tracks as a tribute.

Much appreciated.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#125

Post by jononor »

codedokode wrote: post #100
mwcampbell wrote: post #49

For your listening pleasure, here's a full-length demo. I decided to use the Jonathan Coulton classic "Re Your Brains", because I can legally share and modify his music under its Creative Commons license. First, the original: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Now the derived stems: Vocals: https://mwcampbell.us/tmp/spleeter-demo/jonathan-coulton-re-... Accompaniment: https://mwcampbell.u…

While it's a great technology, the result sounds somewhat robotic. On the original recording the voice sounds soft, but after separation it sounds like it is synthesized or passed through a vocoder, something is missing. The voice contains pieces of strumming sound. Guitar also sounds "blurred", as if someone cut an object from the picture and blurred the cut to make it less visible. Clap sound is distorted, on the o…

People are hard at work on denoising of audio using neural networks also. I would expect that if one trained denoisers for each type of source separated here, and passed the separated audio through them, things would get even better.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#126

Post by jononor »

lebuffon wrote: post #119

Has someone in the Intelligence community approached the author? Oops that's classified. :) This has implications for extracting sounds from noisy recordings or am I off base? Does it only track pitch patterns?

Source separation of speech and speech denoising is a well established field, more researched in general than music source separation. Intelligence officers very likely have access to a range of well-performing ML tools for extracting speech.

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#127

Post by jononor »

jMyles wrote: post #48

Somewhat of a tangent, but does anyone have a recommendation of an open source (ideally python) program that can make MIDI from piano audio?

Automatic music transcription is the technical/academic name of this task. Maybe that can help you in your search?

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#128

Post by mwcampbell »

BrentOzar wrote: post #118
noja wrote: post #102

Earlier quoted context omitted.

So Jonathan Coulton is now the new Suzanne Vega?

> So Jonathan Coulton is now the new Suzanne Vega? Bravo. For people who didn't get the sublime reference, Suzanne Vega's song Tom's Diner was a benchmark test during development of the MP3.[1] [1]: https://en.wikipedia.org/wiki/Tom%27s_Diner#The_"Mother_of_t...

The reference is even more apt because the two of them have collaborated. She sang the led vocal on his song "Now I Am an Arsonist" (from the album Artificial Heart).

Re: Spleeter: Extract voice, piano, drums, etc. from any music track

#129

Post by phkahler »

beachy wrote: post #39
lubujackson wrote: post #35

Earlier quoted context omitted.

Seems like most music (from the 70s on at least) is recorded multi-track and the data is out there, just not accessible to anybody. If you ever watch Rick Beato videos, he takes classic songs and isolates vocal/drum/etc. tracks all the time, I'm not sure how he has access to them: https://www.youtube.com/playlist?list=PLW0NGgv1qnfzb1klL6Vw9... But you probably don't need to bother with old recordings since there is S…

Rick says in one of his videos that he and some of his buddies have got old copies of the original source (separated) tracks, and they kind of pass them around between each other. I find that pretty amazing given the litigiousness of some in the music industry, but there we are. Side note: I discovered Rick Beato a few months ago and I've watched heaps of his videos. It's really fascinating hearing old classics torn…

OMG yes. I watch very little YouTube, but reading these comments I thought "this Rick guy is probably that one I saw a couple months ago, his separated Boston tune was really amazing." And there it is.
Post reply on HN