MusicGen-Looper: Generate fixed-bpm loops from text prompts
1–10 of 25 posts
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#2How is this possible? I thought deep learning models struggle with approximating periodic functions like sin.
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#3How is this possible? I thought deep learning models struggle with approximating periodic functions like sin.
bigvgan paper (https://arxiv.org/pdf/2206.04658.pdf)
"We introduce a proper inductive bias of periodicity to the generator by applying a recently proposed periodic activation called Snake function (Liu et al., 2020), defined as fα(x) = x + 1 α sin2 (αx), where α is a trainable parameter that controls the frequency of the periodic component of the signal and larger α gives higher frequency. The use of sin2 (x) ensures monotonicity and renders it amenable to easy optimization. Liu et al. (2020) demonstrates this periodic activation exhibits an improved extrapolation capability for temperature and financial data prediction."
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#4How is this possible? I thought deep learning models struggle with approximating periodic functions like sin.
Here is the MusicGen paper from Facebook research: https://arxiv.org/abs/2306.05284
MusicGen is an LLM on top of EnCodec tokens, instead of working directly with audio. EnCodec is neural audio compression algorithm that encodes audio as tokens from a codebook. It's a really clever trick!
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#5[deleted]
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#6I would love to see something like track based MusicGen for single instruments/channels that can be mixed.
Just seems like a fundamentally different problem than a photograph or painting.
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#7I think it broke for me because I selected 140.06bpm. Adding 'step=1' to the range slider would help if the floating part was the cause.
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#8"You must sign in to run this model"
In this day and age, curiosity is not worth the risk.
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#9Required me to make an account on github? No thanks.
Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts
#10That thing refused to make me a 160 bpm chicago acid house loop... what a severe lack of imagination :-P