Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MusicLM: Generating music from text

arxiv.org

Post reply on HN
Print view View original

81–90 of 114 posts

Re: MusicLM: Generating music from text

#81

Post by ben_w »

spuz wrote: post #72
ben_w wrote: post #56

Earlier quoted context omitted.

For this specific paper, probably never. From the final section: """We acknowledge the risk of potential misappropriation of creative content associated to the use-case. In accordance with responsible model development practices, we conducted a thorough study of memorization, adapting and extending a methodology used in the context of text-based LLMs, focusing on the semantic modeling stage. We found that only a tiny…

Could someone translate this into layman's terms?

It actually copied some stuff. Not much, but it did, and that's bad.

Re: MusicLM: Generating music from text

#82

Post by williamcotton »

woolion wrote: post #40
snowram wrote: post #33

Earlier quoted context omitted.

You can absolutely "overpaint" sound, as sound can indeed be represented as an image and be extended in frequency of in time. In fact this is exactly what Riffusion is doing.

You sure _can_, but that's not how a music producer works. I meant it as how you could actually use the output into a professional workflow. For images it's definitely easy since it integrates in a meaningful way into the pipeline. And in many cases it improves over photobashing. In music, 'fixing' problems in sound is way more costly, so a producer would say that it's not something you can work with in any reasonabl…

Oooh, using LLMs for "inpainting" audio to remove pops from a vocal take! Or to fix a late snare hit! Of course these tasks can be done right now they just take minutes instead of what could be seconds.

Re: MusicLM: Generating music from text

#83

Post by woolion »

jameshart wrote: post #77
woolion wrote: post #18

I don't really understand why this approached is pushed for music. You can overpaint an image, but you can't do that with a song. Cutting an image to reintroduce coherence is easy too. For a song you need midi, or another symbolic representation. That was the approach of pop2piano (unfortunately it is limited to covers, not generating from scratch). And even if a song generated this is OK, listening to half an hour f…

“For a song you need midi” Pretty sure the Beatles never handed George Martin any midi files. What’s the symbolic representation that captures the tone of every bend in a Hendrix solo? Did Daft Punk go back and grab the raw master stems of the old vinyl recordings they used to assemble their tracks? Music producers have been astonishingly creative given inputs in a vast range of formats. Sheet music and midi are one…

Why do you strawman my argument?

The issue with combining sounds in the mix is the issues add up in a super-linear way. Because of that you could even say that modern music producers tend to care too much about perfect sounds.

The Beatles did not have the same production requirement modern music have since there is high-fidelity equipment. The music industry as a whole changed a lot. Modern music production have multiple passes just to clean up one "perfect vocal take", like de-essing, breath removal, etc. This is insanely more advanced than what was the standard in the 60s. I'm not saying it's better either.

>What’s the symbolic representation that captures the tone of every bend in a Hendrix solo?

That's not how music works. You refer to the score, and the precise way you bend your tones is up to your interpretation. Even if you wanted to copy one-to-one Hendrix, you'd copy the style, not one performance exactly, so capturing every little bend does not really matter.

Which could be an AI project: Hendrixify a guitar track.

Re: MusicLM: Generating music from text

#84

Post by jameshart »

woolion wrote: post #83
jameshart wrote: post #77

Earlier quoted context omitted.

“For a song you need midi” Pretty sure the Beatles never handed George Martin any midi files. What’s the symbolic representation that captures the tone of every bend in a Hendrix solo? Did Daft Punk go back and grab the raw master stems of the old vinyl recordings they used to assemble their tracks? Music producers have been astonishingly creative given inputs in a vast range of formats. Sheet music and midi are one…

Why do you strawman my argument? The issue with combining sounds in the mix is the issues add up in a super-linear way. Because of that you could even say that modern music producers tend to care too much about perfect sounds. The Beatles did not have the same production requirement modern music have since there is high-fidelity equipment. The music industry as a whole changed a lot. Modern music production have mult…

Pretty sure the only score Jimi ever referred to was scoring some weed.

My point is that performances are as valid an input to music production as anything else.

And that these generative snippets are potentially a source of ‘performances’ that producers will tap in creative and interesting ways.

Re: MusicLM: Generating music from text

#86

Post by [deleted] »

rrherr wrote: post #79
bulbosaur123 wrote: post #62

I'm absolutely flabbergasted by rapid progression of music related machine learning models. I've always seen music as the "final frontier". With images you can have tiny errors and noise that isn't that noticeable by the human eye, but with music everything has to be impeccable and if a note is slightly off, you instantly hear it. Machine learning models that will be able to create outstanding music, imo, will mark t…

> Anyone want to share their experiments with MusicLM, feel free to join How can we experiment with MusicLM? The paper’s last sentence says, “We have no plans to release models at this point.”

[deleted]

Re: MusicLM: Generating music from text

#87

Post by epistemer »

georgehill wrote: post #2

Demo: https://google-research.github.io/seanet/musiclm/examples/

Epic soundtrack using orchestral instruments is somewhat interesting as electronic music but to me everything else is pretty bad.

There is a million Industrial techno sounds, repetitive, hypnotic rhythms IDM tracks that absolutely no one listens to anymore. Most the founders of the whole genre have moved on from lack of interest.

We have been able to do really good generative music in Reaktor for the last 20 years. Much better than anything on this page but no one cares.

People in general want to hear the same slight variation in music over and over as background noise.

The people that are saying how great all this is will be bored with it in 2 weeks or less. Pure technological kitsch.

Re: MusicLM: Generating music from text

#88

Post by cma »

papruapap wrote: post #28
TaupeRanger wrote: post #8

Yet another cherry picked attempt at music gen with a "demo" page that only contains the outputs that happen to not sound like incoherent noise. There's a reason ChatGPT and Midjourney are so popular, but no music-gen tools have even come close: you can actually create stuff with them that is useful and/or enjoyable. Good music gen is much harder, and the reasons for this (still unclear) are pretty important to the f…

Well... no all releases have to be toys for your average twitter user to play with. Most of them are just academic stuff to show team progress.

I'm not saying it about this one, but some are akin to Nikola rolling their truck down a hill. Like the Google phone assistant one that would call and make appointments for you and stuff. Very likely cherrypicked at the time. Or Microsoft's Milo, which was almost entirely staged.

Re: MusicLM: Generating music from text

#89

Post by CuriouslyC »

epistemer wrote: post #87
georgehill wrote: post #2

Demo: https://google-research.github.io/seanet/musiclm/examples/

Epic soundtrack using orchestral instruments is somewhat interesting as electronic music but to me everything else is pretty bad. There is a million Industrial techno sounds, repetitive, hypnotic rhythms IDM tracks that absolutely no one listens to anymore. Most the founders of the whole genre have moved on from lack of interest. We have been able to do really good generative music in Reaktor for the last 20 years. M…

Let's be clear, this is a tech demo, the application is not going to be prompting infinite streams of low quality music. The application of this stuff is to enable creative tools (got a beat and some vocals, give me a bassline and backing chorus), real time computer jam partners, to provide "good enough" music for indie games/movies.

These models are still in their early phases - If AI was combustion engines, we wouldn't even be to railroads yet. Despite that, they're still fun to play with and useful when used correctly.

Re: MusicLM: Generating music from text

#90

Post by chasing »

epistemer wrote: post #87
georgehill wrote: post #2

Demo: https://google-research.github.io/seanet/musiclm/examples/

Epic soundtrack using orchestral instruments is somewhat interesting as electronic music but to me everything else is pretty bad. There is a million Industrial techno sounds, repetitive, hypnotic rhythms IDM tracks that absolutely no one listens to anymore. Most the founders of the whole genre have moved on from lack of interest. We have been able to do really good generative music in Reaktor for the last 20 years. M…

Yeah, as far as electronic music goes, maybe people don't realize just how good (and automated) the current tools are. And have been for years.
Post reply on HN