Modeled reverb yet no modeled compressor, hrmm, is compression not used on kick drums (or not a big part of the sound)?
How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
21–30 of 93 posts
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#22I always roll my eyes when I see LLM weirdos talk about getting models to run on "old" hardware and finding out it's hardware that's still better than what most people have access to. It doesn't make it any less impressive to those who know what hardware requirements for LLMs usually is/are but for those with no idea it usually ends up reinforcing bitterness towards it as they feel annoyed that their own hardware is…
> but for those with no idea it usually ends up reinforcing bitterness towards it as they feel annoyed that their own hardware is somehow worse
I don't think "those with no idea" spend much time thinking about their hardware at all. They respond to marketing and peer-pressure influences, but most of them are not upgrading phones or laptops because they can't run AI on it.
Most people I know have been wanting upgrade cycles to slow down for quite some time, now. I think that those people will survive deferred retail therapy for a few years.
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#23Excellent article! I think it has the right level of detail, one question though: why the shape of the tensor? 4x8x11. That I didn't get from the text.
the spectrograms are 128x173 (128 mel frequency bins by 173 time frames)
the encoder is downsampling 4 stages of stride 2 convolutions so it halves dimensions 4 times
0: 128 x 173
1: 64 x 87
2: 32 x 44
3: 16 x 22
4: 8 x 11
Then i used 4 separate channels.
This was somewhat arbitrary due to the local training constraint. This would be a hyper parameter worth tuning if I had time to dig into this more.
I trained this a few month ago and don't remember exactly what I tried before I arrived here, but I only ran the whole process 2 or 3 times because of how long it took to train. Hope this answers your question!
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#24Modeled reverb yet no modeled compressor, hrmm, is compression not used on kick drums (or not a big part of the sound)?
The compression is the OTT which stands for Over The Top compression. It was originally a multiband compressor preset in ableton and is now used widely throughout dance music.
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#25People who are interested in this application should check synplant[0]. It has a ML technology called "Genopatch" which gives you 2 functionality:
1. you can try to describe a sound with some tags and it will try to generate a sound to capture the feeling of these tags
2.you can feed it with a sound sample and it will try to re-synthesize the sound with its synth engine. Though the end result will usually be just a "re-imagined" version of your input sample.
My guess is the underlying model is not a "deep" model. The main benefit is that the end result is not a wave file, but a list of generated parameters that can be synthesized by the synthplant engine. And now it comes the interesting part: you can tweak these parameters to finetune the generated sound. These parameters have actual meanings (FM ratio, reverb etc.)
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#26Excellent article! I think it has the right level of detail, one question though: why the shape of the tensor? 4x8x11. That I didn't get from the text.
the spectrograms are 128x173 (128 mel frequency bins by 173 time frames) the encoder is downsampling 4 stages of stride 2 convolutions so it halves dimensions 4 times 0: 128 x 173 1: 64 x 87 2: 32 x 44 3: 16 x 22 4: 8 x 11 Then i used 4 separate channels. This was somewhat arbitrary due to the local training constraint. This would be a hyper parameter worth tuning if I had time to dig into this more. I trained this a…
Yeah, thanks!!
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#27For a moment I thought Gen AI meant the current generation of kids. It's a fitting moniker
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#28someone needs to take care of the snares
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#29People who are interested in this application should check synplant[0]. It has a ML technology called "Genopatch" which gives you 2 functionality: 1. you can try to describe a sound with some tags and it will try to generate a sound to capture the feeling of these tags 2.you can feed it with a sound sample and it will try to re-synthesize the sound with its synth engine. Though the end result will usually be just a "…
How far are we from getting a general model that can resynthesize any instrumental audio sound without fiddling with any knobs, so that we can recreate instruments we hear from any song? Seems like it should exist by now?
Re: How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM
#30People who are interested in this application should check synplant[0]. It has a ML technology called "Genopatch" which gives you 2 functionality: 1. you can try to describe a sound with some tags and it will try to generate a sound to capture the feeling of these tags 2.you can feed it with a sound sample and it will try to re-synthesize the sound with its synth engine. Though the end result will usually be just a "…
synplant is a great synth!