Show HN: Downloadable AI Musical Instruments

#1

Post by abdljasser2 » Tue, Dec 10, 2024, 12:50 AM UTC

Generate soundfonts from text descriptions using latent flow matching. You can then download the complete SFZ soundfont package to use the instrument locally.

Show HN: Downloadable AI Musical Instruments
huggingface.co

Re: Show HN: Downloadable AI Musical Instruments

#2

Post by RMWildly » Tue, Dec 10, 2024, 1:46 PM UTC

I had some fun trying to get this to work with prompts based on specific brands etc. It felt like it had a pretty good attempt at a Fender Jazz Bass and a Moog Mother, but struggled with a Juno 6. Is that pure coincidence or would the model be able to understand the semantics of specific instruments and things as well as more generic terms?

Re: Show HN: Downloadable AI Musical Instruments

#3

Post by abdljasser2 » Tue, Dec 10, 2024, 4:47 PM UTC

RMWildly wrote: post #2

I had some fun trying to get this to work with prompts based on specific brands etc. It felt like it had a pretty good attempt at a Fender Jazz Bass and a Moog Mother, but struggled with a Juno 6. Is that pure coincidence or would the model be able to understand the semantics of specific instruments and things as well as more generic terms?

Good question. In my experience combining generic descriptors is what works best. This is probably due to the text captions used during training mostly consist of generic instrument names, genre names and adjectives.