Live data from Hacker News

Riffusion – Stable Diffusion fine-tuned to generate music

riffusion.com

361–370 of 481 posts

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#361

Earlier quoted context omitted.

Those making the decisions can very well just say "WE and a 10-20% still needed just need to live comfortably, and the rest 80% can live in slums in the edge of town".

That sounds like the "revolution" option.

Sadly, if we look at human history, it usually resolves to that.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#362

Earlier quoted context omitted.

That sounds like the "revolution" option.

Sadly, if we look at human history, it usually resolves to that.

But not always. And education and communication are some of the forces that can help avoid that.

Knowledge is power.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#363

This opens up ideas. One thing people have tried to do with stable diffusion is create animations. Of course, they all come out pretty janky and gross, you can't get the animation smooth. But what if what if a model was trained not on single images, but animated sequential frames, in sets, laid out on a single visual plane. So a panel might show a short sequence of a disney princess expressing a particular emotion as…

We are back to sprite maps

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#365
post #88
post #87

Earlier quoted context omitted.

Can you run this on any hardware already capable of running SD 1.5? I am downloading the model right now, might play with this later. Guessing at the speed with which AI is developing these days someone is going to have the extension up in two hours at most.

I bet the AUTOMATIC1111 web UI music plugin drops within 48 hours.

I have made a basic version here:

https://github.com/enlyth/sd-webui-riffusion

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#366

This opens up ideas. One thing people have tried to do with stable diffusion is create animations. Of course, they all come out pretty janky and gross, you can't get the animation smooth. But what if what if a model was trained not on single images, but animated sequential frames, in sets, laid out on a single visual plane. So a panel might show a short sequence of a disney princess expressing a particular emotion as…

That's an interesting idea. I wonder if this would work with inpainting - erase the 16th cell and let the AI fill it in. Then upscale each frame. Has anyone experimented with this?

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#367
This is awesome! It would be interesting to generate individual stems for each instrument, or even MIDI notes to be rendered by a DAW and VST plugins. It's unfortunate that most musicians don't release the source files for their songs so it's hard to get enough training data. There's a lot of MIDI files out there but they don't usually have information about effects, EQ, mastering, etc.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#370

It may be clearer to those of you who are smarter than me, but I guess I've only recently begun to appreciate what these experiments show--that AI graphical art, literature, music and the like will not succeed in lowering the barriers to humans making things via machines but in training humans to respond to art that is generated by machines. Art will not be challenging but designed by the algorithm to get us to like…

Right now, the AI is trained on mostly human generated art. It will be interesting to see what happens when the training set itself is mostly AI generated. The role of the "artist" in the future will not be to create art directly, but to influence art by manipulating the training set. For instance an artist who can flood the Internet with a trillion captioned images will be able to spawn an art movement, even if it short lived.
Post reply on HN