Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MusicGen-Looper: Generate fixed-bpm loops from text prompts

replicate.com

Post reply on HN
Print view View original

11–20 of 25 posts

Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts

#11

Post by IanCal »

fagerhult wrote: post #4
KRAKRISMOTT wrote: post #2

How is this possible? I thought deep learning models struggle with approximating periodic functions like sin.

Here is the MusicGen paper from Facebook research: https://arxiv.org/abs/2306.05284 MusicGen is an LLM on top of EnCodec tokens, instead of working directly with audio. EnCodec is neural audio compression algorithm that encodes audio as tokens from a codebook. It's a really clever trick!

The samples are outstanding. Even if they are cherry picked (not saying they are but even if) the output seems incredible.

https://ai.honu.io/papers/musicgen/

Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts

#18

Post by tessierashpool »

dylan604 wrote: post #16
JodieBenitez wrote: post #10

That thing refused to make me a 160 bpm chicago acid house loop... what a severe lack of imagination :-P

> what a severe lack of imagination I think you just described chicago acid house :-P

fuck you

Re: MusicGen-Looper: Generate fixed-bpm loops from text prompts

#19

Post by verst »

It doesn't seem to like slow music. I jokingly gave it a prompt to create a wedding ceremony processional music for the entrance of the bride at ~60bpm (I'm getting married in 2.5 weeks). EDIT: Exact prompt "wedding procession bride entrance"

File "predict.py", line 211, in predict raise ValueError( ValueError: Failed to generate a loop in the requested 60.23 bpm. Please try again.

EDIT: At 52 bpm (exact) it seems to work. What it generated would not sound good if looped however. In terms of style.. it sounded a little music box like - celesta or so (think of the beginning of the Harry Potter soundtrack) with some sustained strings and pizzicato strings. That would be appropriate, except the rhythm and chords are fairly random and I wouldn't exactly call this musical :)

Post reply on HN