Live data from Hacker News

How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

zhinit.dev

61–70 of 93 posts

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#62
post #59

Confused. Why not just make the kick drum from a sine? Seconds

Its possible and boy do i have a youtube channel for you https://youtu.be/ndG-6-vONNc https://youtu.be/8dfgum9XlJc

Good modelling

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#65
post #54

Slightly off-topic. Now that 1920s jazz music is falling into public domain, has anyone tried to reinvigorate the music using AI and generative adversarial approaches? Pre-1940s music didn't have high-fidelity sound, so the strong bass lines weren't captured. In theory, we could "downgrade" modern recordings to sound like 1920s recordings, then use adversarial techniques to train the machine on how to restore the ant…

It might be easier than that. Are the bass lines totally missing or are they just very weak? If you can capture a recording using vintage equipment and the placing of it, you can get the system response. Run the original recordings through an inversion of the response and you should get really close. Another possible method is to find the transform between an identical modern recording of the song and use the differe…

Neither. You can hear them if you listen carefully, just the recording tech plus lack of amplification makes it harder than modern music.[1]

Source: have degree and postgrad in jazz and used to be a bass player. Have made transcriptions of early bass players from original recordings. (by ear without any kind of fancy tech)

[1] and the playing technique for various reasons.

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#66

Slightly off-topic. Now that 1920s jazz music is falling into public domain, has anyone tried to reinvigorate the music using AI and generative adversarial approaches? Pre-1940s music didn't have high-fidelity sound, so the strong bass lines weren't captured. In theory, we could "downgrade" modern recordings to sound like 1920s recordings, then use adversarial techniques to train the machine on how to restore the ant…

The problem is AI "improvisation".

I could take my sequencer and crank the tempo up to a level on a Chopin etude that would smoke Yuja Wang too.

Who cares? The performance that is interesting is a human performance under these artistic constraints.

We didn't need transformers for algorithmic jazz or algorithmic composition in general.

It is also the bullshit of algorithmic Bach. Bach produced 1,100 works and most people haven't listened to even 1% of arguably the greatest artist who ever lived. What is the point of generating more?

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#67
post #29
post #25

People who are interested in this application should check synplant[0]. It has a ML technology called "Genopatch" which gives you 2 functionality: 1. you can try to describe a sound with some tags and it will try to generate a sound to capture the feeling of these tags 2.you can feed it with a sound sample and it will try to re-synthesize the sound with its synth engine. Though the end result will usually be just a "…

How far are we from getting a general model that can resynthesize any instrumental audio sound without fiddling with any knobs, so that we can recreate instruments we hear from any song? Seems like it should exist by now?

In the early days of FM synthesis it was not uncommon to hear the refrain "FM synthesis can reproduce any sound you can hear on the radio" from some of the wilder-haired synth nerds of the time.

Aphex Twins' MIDI Mutant came pretty close (quite a few years ago now) to delivering on that promise:

https://magazine.raspberrypi.com/articles/aphex-twin-midimut...

I'm pretty sure another pass at this problem would prove quite fruitful - as others have noted elsewhere in this thread, there are tools like SynPlant which promise this kind of functionality, although - for my needs - I much prefer AT's approach, having it all in a single box.

Seems to me that the Zynthian/Monome[1] folks might have something like this in their toolkits, somewhere. Might be time to catch up with those projects...

[1] = https://zynthian.com / https://monome.org

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#69
post #35

Earlier quoted context omitted.

For me creating the exact sound is not very interesting from sound designing perspective. You can always sample the real instrument. Like physical modeling synthesis, the interesting part is to compress the sound to some parameters that you can tweak and generate new sounds Another approach is VAE, which also you give your some latent embedding, you can tweak the embedding to generate new sound. However the meaning o…

"You can always sample the real instrument." This doesn't really work on instruments like guitars. Open D sounds way different than fretted D on the E string. Timbre changes with position and it's one of the ways I determine where a player's hands are on the neck when I'm trying to play their song.

It doesn't even work for most instruments, nearly every instrument can sound differently depending on how you play it. A violin sounds different depending on how close the bow is to the bridge, a piano sounds different depending on which pedals are pressed and whether the lid is open, a trumpet sounds different depending on whether there is a cup in front of it and where. Experienced musicians know how to use these effects to create the right feeling.

And that's only based on how little I know about this.

Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

#70
post #54

Slightly off-topic. Now that 1920s jazz music is falling into public domain, has anyone tried to reinvigorate the music using AI and generative adversarial approaches? Pre-1940s music didn't have high-fidelity sound, so the strong bass lines weren't captured. In theory, we could "downgrade" modern recordings to sound like 1920s recordings, then use adversarial techniques to train the machine on how to restore the ant…

It might be easier than that. Are the bass lines totally missing or are they just very weak? If you can capture a recording using vintage equipment and the placing of it, you can get the system response. Run the original recordings through an inversion of the response and you should get really close. Another possible method is to find the transform between an identical modern recording of the song and use the differe…

The problem might be more complicated. In those times, they might not use a separate mic for every instrument (and the mics probably were not great), they might might not do the mastering properly, the amps could distort the sound, and instruments could overlap each other. And if you try to simply amplify lower frequencies, you might end up getting too much noise.
Post reply on HN