Live data from Hacker News

Riffusion – Stable Diffusion fine-tuned to generate music

riffusion.com

471–480 of 481 posts

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#471
post #176

Pretty nice, I was just talking to a friend about needing a music version of chatgpt, so thank you for this. Wondering if it would be possible to create a version of this that you can point at a person SoundsCloud and have it emulate their style / create more music in the style of the original artist. I have a couple albums worth of downtempo electronic music I would love to point something like this at and see what…

We are working on something similar at Neptunely. https://neptunely.com

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#472

I'm a short fiction writer. Do you think I could get one of these new models to write a good story? I'd want to train it to include foreshadowing, suspense, relatable characters and perhaps a twist ending that cleverely references the beginning.

I think it is possible. Have you tried interacting with chatGPT on short story?

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#473

Do you guys think AI creative tools will completely subsume the possibility space of human made music? Or does it open up a new dimension of possibilities orthogonally to it? Hard for me to imagine how AI would be able to create something as unique and human as D'Angelo's Voodoo (esp. before he existed) but maybe it could (eventually). If I understand these AI algorithms at a high level, they're essentially finding p…

I dont think its possible to make a compelling song in quite the same way. At Neptunely, we are pursuing a route that keeps the human in the picture. More of a collaboration. https://neptunely.com

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#474

Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…

Super clever idea of course. But leaving aside how it was produced, I’ll be one of those who is underwhelmed by the musicality of this. I am judging this in terms of classical music. I repeatedly tried to get it to just play pure piano music without any other add-ons (cymbals etc). It kept mixing the piano with other stuff.

Also the key question is - would something like this ever produce something as hauntingly beautiful and unique as classical music pieces?

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#475
This is genuinely amazing. Like with any AI there are areas it's better at than others. I hope it doesn't go unnoticed just because people try typing "death metal" and are not happy with the results. This one seems to excel at 70-130BPM lo-fi vaporwave/washed out electronic beats. Think Ninja Tune or the modern lo-fi beats to study to. Some of this stuff genuinely sounds like something I'd encounter on Bandcamp or Soundcloud.

I think I'm beginning to crack the code with this one, here's my attempt at something like a "DJ set" with this. My goal was to have the smoothest transitions possible and direct the vibe just like I would doing a regular DJ set. https://www.youtube.com/watch?v=BUBaHhDxkIc

I wonder if this could be the future of DJing or perhaps beginning of a new trend in live music making kind of like Sonic Pi. Instead of mixing tracks together, the DJ comes up with prompts on the spot and tweaks AI parameters to achieve the desired direction. Pretty awesome.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#476

Earlier quoted context omitted.

This was the first AI thing to fill me with a feeling of existential dread.

What is with the hyperbole in this thread? This stuff sounds like incoherent noise. It is noticeably worse than AI audio stuff I heard 5 years ago. What is going on with the responses here?

I feel exactly the opposite way, but I suppose everyone has a different ear and taste. I think a good 3-4% of what this produces sounds damn amazing and beautiful. I've been vibing to it a lot. Fantastic stuff! There is also the feeling of shock and awe like with ChatGPT where you give it a prompt about a niche thing you think it will definitely not understand and it turns out it understands it shockingly well. As an example I just gave it a prompt "Avril 4th" and the result literally gave me chills.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#477
post #327

Earlier quoted context omitted.

That seems a bit like wishful thinking. People don't have unlimited ability to learn new skills. Training takes time, and someone who spent several years honoring their craft won't be able to pick up a new skill overnight. On top of that, people have preferences regarding their work – even if someone has the ability to do a different work, they might find it less meaningful and less satysfing. Finally, don't ignore t…

Agree 100%. When I was young and idealistic I believed in the "learn new skills" mantra, but learning completely new skills would look a lot different at 50 than it did at 20. When career choices were being made 30 years ago it would have been hard to predict the current & upcoming AI-driven destruction of lower-end "thinking" jobs. Attempting to retrain after ~30 years puts you at a massive disadvantage vs a new gra…

I agree that intentional retraining doesn’t really work, but I don’t think it matters. As I said, all that matters for whether you have a job is the Federal Reserve. If you hire random people to do a computer job, some of them will just turn out to magically learn everything on the job.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#478
post #395

Earlier quoted context omitted.

Gregorian death metal folk also seems to have lacked seed tunes but the thing is just in its infancy so soon we'll be banging our tonsured heads to the folky beats of ... ...OK, need to create a band name generator to work in tandem with this thing. Let's see what one of its brethren in ML makes of it... - "Echoes of the Past": This name plays on the idea of Gregorian chanting, which is often associated with the dist…

Somewhat unrelated, but given the descriptions, perhaps you should take a listen to the Darktide 40k soundtrack if you haven't: https://www.youtube.com/watch?v=D4hEOMSjzdo

Yes, that sounds like something which goes in the right direction. Now just drop the modern stuff - the synth bass beat doesn't really fit the description - and have some more Gregorian growl and Lucifer's your uncle.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#480
post #407

Earlier quoted context omitted.

assuming the first sample was generated by OP method, how did you clean that sample up so nicely?

Yep, the first sample was generated via OP's method. The tl;dr answer is that I used a few plugins in my digital audio workstation to make it sound better. I made a video specifically in reply to you if you want to see exactly how I did it (3 mins): https://www.youtube.com/watch?v=69Q-cseNCI4

Thank you so much!
Post reply on HN