Live data from Hacker News

MusicLM: Generating Music from Text

google-research.github.io

21–30 of 46 posts

Re: MusicLM: Generating Music from Text

#21
post #5

Wow that is awesome. Hopefully the first feature they'll add will be to spit out midi rather than wavs (or ML that can decompose wavs to midi)

This is literally trained on and is processing at the level of the audio bitstream. So, getting it to 'spit out midi' would be no different than the current task of taking a full, mixed audio track and generating MIDI from it (which isn't easy). This is using a transformer architecture directly on tokenization of .wav audio. There is no underlaying stage of 'instrumentation' like a MIDI track is before it gets synthesized into an audio stream.

Re: MusicLM: Generating Music from Text

#23

Art in all its forms had always serious problems getting funded but things only seem to get worse at each iteration. In older times the problem was that most people had other worries, so artist numbers were small and they seeked patronage from the elites that could afford it. Later we had mass commercialization which "democratized" art but artists got squeezed by the intermediaries / distributors that enabled the mas…

Perhaps the lesson is that art ought to be done because it is inherently fulfilling and not a as a profession.

Re: MusicLM: Generating Music from Text

#24

This is unbelievable. I would have never expected AI to take the jobs of creatives first, but here we are. Artists and musicians can create much better work than AI, but the AI creates consistent works usable for people who aren’t artists, and need assets for their projects — whether video games, prototyping, storyboarding, etc. It is going to be interesting to see artists revert to being a no-revenue passion again i…

I would argue that the people who use AI generated assets and combine them for a bigger thing such as a video game are still artists. They are simply realizing their vision on a higher level.

Re: MusicLM: Generating Music from Text

#25
A bit sad to see that the audio in the (great!) dataset consists of links to YouTube videos with timecodes, knowing the war on youtube-dl that happened just last year (long live yt-dlp !). Not really future-proof either.

Re: MusicLM: Generating Music from Text

#26

This is unbelievable. I would have never expected AI to take the jobs of creatives first, but here we are. Artists and musicians can create much better work than AI, but the AI creates consistent works usable for people who aren’t artists, and need assets for their projects — whether video games, prototyping, storyboarding, etc. It is going to be interesting to see artists revert to being a no-revenue passion again i…

> "...At the same time, a part of me feels art has no place being motivated by money anyway. Perhaps this change will restore the balance. Artists will need to get real jobs again like the rest of us and fund their art as a side project..."

I seems to be missed on your comment, the AI will take on the real job first. The real job you were planning to reserve as survival means for the artist... are we not all now, creatives out of a job and without a backup plan?

Re: MusicLM: Generating Music from Text

#27
This reminded me of DirectMusic; I remember the demos back in early 2000s (I think it was Age of Empires) where the music was dynamically generated based on what you were doing in the game (smooth transitions and everything).

I wonder why that never went anywhere.

Re: MusicLM: Generating Music from Text

#29

This is unbelievable. I would have never expected AI to take the jobs of creatives first, but here we are. Artists and musicians can create much better work than AI, but the AI creates consistent works usable for people who aren’t artists, and need assets for their projects — whether video games, prototyping, storyboarding, etc. It is going to be interesting to see artists revert to being a no-revenue passion again i…

> At the same time, a part of me feels art has no place being motivated by money anyway. Perhaps this change will restore the balance. Artists will need to get real jobs again like the rest of us and fund their art as a side project.

As someone who has experienced both the career paths of a full-time musical artist and technical employee in the tech ecosystem, I find this comment saddening, because it revolves around a highly prevalent way of thinking in our society that needs to die.

Why shouldn't artists have their own career? Why wouldn't you consider this a "real job"?

My experience as an individual artist is that it feels very much like being the founder of a company. You’re dealing with technical, administrative, logistical, marketing issues every day, and you’re required to wear many hats until you generate enough revenue to use external actors/hire a few people.

With all due respect: best-case scenario, these lines might be fuelled by a form of untold jealousy; at worst, they reveal how deeply pessimistic and capitalist our worldview has become. Because such situations have long been observable in modern society, we listeners confuse this longitudinal data with empirical truth, when in reality it’s very much preserved by corporate interests and power dynamics within the music industry.

Artists have long been the last agent of the music business to be paid, and usually get the smallest slice of the cake. This is mostly preserved by a handful of actors who benefit most from this situation. Enter: 1. Labels (including, but not limited to, majors) exploiting the complexity of music rights (master, publishing royalties, ancillary rights, etc.) and imposing harsh contractual conditions on artists. 2. Digital streaming platforms (DSPs) built on vastly unprofitable, VC-money-ridden business models and making up for it by squeezing every possible bit of revenue they can.

The ever-persistent myth of the romantic, tortured artist who needs to live on skid row and experience dire living conditions to create the purest piece of art, devoid of any mercantilism is another problematic piece of the puzzle.

Empirically, extreme precariousness throughout the art world leads to mental health issues I’ve experienced first-hand and observed with many colleagues. When you don’t have the physical or mental resources to produce art, because you’re living from hand to mouth and focused on making a buck on the side, it directly and negatively impacts your practice. A steady, albeit small, income goes a long way.

But because gig-economy mechanisms and atomization of the artistic practice vastly profit the aforementioned actors (you could also throw in social networks, with their black-box, engagement-driven algorithmic updates), it stays the same.

Bottom line, it doesn’t have to be this way. That the ad-tech bubble is about to burst, or that some startup relied way too much on free VC money to prolong its ill-thought-out business model should not have such a drastic impact on the vast majority of artists. And more importantly, citizens like you and I should have no part in perpetuating these toxic mentalities.

Van Gogh was commercially unsuccessful during his lifetime and suffered from severe depression when he cut his left ear off; and here we are arguing this social model is the right one.

My 2 cents.

Re: MusicLM: Generating Music from Text

#30

Art in all its forms had always serious problems getting funded but things only seem to get worse at each iteration. In older times the problem was that most people had other worries, so artist numbers were small and they seeked patronage from the elites that could afford it. Later we had mass commercialization which "democratized" art but artists got squeezed by the intermediaries / distributors that enabled the mas…

Perhaps the lesson is that art ought to be done because it is inherently fulfilling and not a as a profession.

One could say the same thing about programming. If I'm playing or writing music for people, and they are enjoying it, I want to get paid.
Post reply on HN