Live data from Hacker News

Riffusion – Stable Diffusion fine-tuned to generate music

riffusion.com

41–50 of 481 posts

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#41
The vocals in these tracks are so interesting. They sound like vocals, with the right tone, phonemes. and structure for the different styles and languages but no meaning.

Reminds me of the soundtrack to Nier Automata which did a similar thing: https://youtu.be/8jpJM6nc6fE

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#42

This is a genius idea. Using an already-existing and well-performing image model, and just encoding input/output as a spectrogram... It's elegant, it's obvious in retrospective, it's just pure genius. I can't wait to hear some serious AI music-making a few years from now.

> I can't wait to hear some serious AI music-making a few years from now.

I think this will be particularly useful for musical compositions in movies and film, where the producer can "instruct" the AI about what to play, when, and how to transition so that the music matches the scene progression.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#43
Do you guys think AI creative tools will completely subsume the possibility space of human made music? Or does it open up a new dimension of possibilities orthogonally to it? Hard for me to imagine how AI would be able to create something as unique and human as D'Angelo's Voodoo (esp. before he existed) but maybe it could (eventually).

If I understand these AI algorithms at a high level, they're essentially finding patterns in things that already exist and replicate it w some variation quite well. But a good song is perfect/precise in each moment in time. Maybe we'll only be ever be able to get asymptotically closer but never _quite_ there to something as perfectly crafted a human could make? Maybe there will always be a frontier space only humans can explore?

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#44
I bet a cool riff on this would be to simply sample an ambient microphone in the workplace and use that the generate and slowly introduce matching background music that fits the current tenor of the environment. Done slowly and subtly enough I'd bet the listener may not even be entirely aware its happening.

If we could measure certain kinds of productivity it might even be useful as a way to "extend" certain highly productive ambient environments a la "music for coding".

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#45
post #3

Really cool. Can't get this to work on the homepage though. Might be a traffic thing? Edit: Works now. A bit laggy but it works. Brilliant!

I'm getting this back when I try to hear cats sing me a rock opera: {"data":{"success":true,"worklet_output":{"error":"Model version 5qekv1q is not healthy"},"latency_ms":530}}

Same here, servers are overloaded probably. Shame, I was really looking forward to a Wu Tang Clan and Jamiroquai collab

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#47
post #38

This is really cool but can someone tell me why we are automating art? Who asked for this? The future seems depressing when I look at all this AI generated art.

Because art is the low hanging fruit of "close enough" applications.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#50
post #12

For the 30 anniversary? https://warp.net/gb/artificial-intelligence

Nice reference! I had never seen that site before, but those albums had a significant impact on my musical journey.

There was a purple victorian house in Colorado Springs where the living room was converted into a record and cd store called Life By Design. I picked up these albums and a ton of other obscure music there. I was so happy to not have to drive all the way up to Wax Trax in Denver to be able to discover new artists.

Post reply on HN