Damn this is insane. I wonder what other things can be encoded as images and generated with SD?
Riffusion – Stable Diffusion fine-tuned to generate music
91–100 of 481 posts
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#92This is really cool but can someone tell me why we are automating art? Who asked for this? The future seems depressing when I look at all this AI generated art.
> Who asked for this?
I did.
> The future seems depressing when I look at all this AI generated art.
You should talk about your concerns with an AI psychotherapist.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#93Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…
All the AI music I’ve heard so far has a really unpleasant resonant quality to it. Why is that? Can it be removed?
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#94Earlier quoted context omitted.
Can you run this on any hardware already capable of running SD 1.5? I am downloading the model right now, might play with this later. Guessing at the speed with which AI is developing these days someone is going to have the extension up in two hours at most.
Yes! Although to have real time playback with our defaults you need to be able to generate 40 steps at 512x512 in under 5 seconds.
Good to know. I was just so close with just under 7s using 40 steps and Euler a as sampler.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#95No post body was provided.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#96This is really cool but can someone tell me why we are automating art? Who asked for this? The future seems depressing when I look at all this AI generated art.
Because art is the low hanging fruit of "close enough" applications.
I wonder if this is true for music. Our ears are much more discerning than our eyes when it comes to art it seems.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#97I was thinking about this - what if someone trained a stable diffusion type model on all of the worlds commercial music? This model would probably produce quite amazing music given enough prompting and I'm wondering if the music industry would be allowed to claim copyright on works created with such a model. Would it be illegal or is this just like a musician picking up ideas from hearing the world of music? Is it really right to make learning a crime, even if machines are doing it? I'm conflicted after finding out that for sync licensing the music industry want a percentage of revenue based on your subscription fees, sometimes as high as 15%-20%! I'm surprised such a huge fee isn't considered some kind of protection racket.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#98A network trained on spectrograms only should do much better.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#99Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…
All the AI music I’ve heard so far has a really unpleasant resonant quality to it. Why is that? Can it be removed?
Presumably for similar reasons that the vast majority of AI generated art and text is off-puttingly hideous or bland. For every stunning example that gets passed around the internet, thousands of others sucked. Generating art that is aesthetically pleasing to humans seems like the Mt. Everest of AI challenges to me.
Re: Riffusion – Stable Diffusion fine-tuned to generate music
#100I was thinking about this - what if someone trained a stable diffusion type model on all of the worlds commercial music? This model would probably produce quite amazing music given enough prompting and I'm wondering if the music industry would be allowed to claim copyright on works created with such a model. Would it be illegal or is this just like a musician picking up ideas from hearing the world of music? Is it re…
This question has been explored before, see Kologorov Music:
https://www.youtube.com/watch?v=Qg3XOfioapI