Reminds me of the soundtrack to Nier Automata which did a similar thing: https://youtu.be/8jpJM6nc6fE
Riffusion – Stable Diffusion fine-tuned to generate music
41–50 of 481 posts
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#42This is a genius idea. Using an already-existing and well-performing image model, and just encoding input/output as a spectrogram... It's elegant, it's obvious in retrospective, it's just pure genius. I can't wait to hear some serious AI music-making a few years from now.
I think this will be particularly useful for musical compositions in movies and film, where the producer can "instruct" the AI about what to play, when, and how to transition so that the music matches the scene progression.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#43If I understand these AI algorithms at a high level, they're essentially finding patterns in things that already exist and replicate it w some variation quite well. But a good song is perfect/precise in each moment in time. Maybe we'll only be ever be able to get asymptotically closer but never _quite_ there to something as perfectly crafted a human could make? Maybe there will always be a frontier space only humans can explore?
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#44If we could measure certain kinds of productivity it might even be useful as a way to "extend" certain highly productive ambient environments a la "music for coding".
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#45Really cool. Can't get this to work on the homepage though. Might be a traffic thing? Edit: Works now. A bit laggy but it works. Brilliant!
I'm getting this back when I try to hear cats sing me a rock opera: {"data":{"success":true,"worklet_output":{"error":"Model version 5qekv1q is not healthy"},"latency_ms":530}}
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#46Re: Riffusion – Stable Diffusion fine-tuned to generate music
#47This is really cool but can someone tell me why we are automating art? Who asked for this? The future seems depressing when I look at all this AI generated art.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#48Re: Riffusion – Stable Diffusion fine-tuned to generate music
#49Authors here: Fun to wake up to this surprise! We are rushing to add GPUs so you can all experience the app in real-time. Will update asap
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#50For the 30 anniversary? https://warp.net/gb/artificial-intelligence
There was a purple victorian house in Colorado Springs where the living room was converted into a record and cd store called Life By Design. I picked up these albums and a ton of other obscure music there. I was so happy to not have to drive all the way up to Wax Trax in Denver to be able to discover new artists.