Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Riffusion – Stable Diffusion fine-tuned to generate music

riffusion.com

Post reply on HN
Print view View original

261–270 of 481 posts

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#261

Post by WanderPanda »

w-m wrote: post #196
th0ma5 wrote: post #188

Earlier quoted context omitted.

Does the institute not also claim that work?

Fair enough. But for me, when talking about `having an insight`, I don't imagine a non-human entity doing that. And to be pedantic (talking about Germans doing research, I hope everyone would expect me to be), the institute is called Fraunhofer IIS. `Fraunhofer` would colloquially refer to the society, which is an organization with 76 institutes total. Although, of course, the society will also claim the work...

Bringing the right people together and having the right environment that gives rise to „having an insight“ can be a big part as well.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#262

Post by joelrunyon »

haykmartiros wrote: post #59

Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…

The site isn't working for me? Anything I have to fix on my side to make it work?

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#263

Post by [deleted] »

antognini wrote: post #156
xnzakg wrote: post #138

Earlier quoted context omitted.

Considering Stable Diffusion generates 3-channel (RGB) images, maybe it would be possible to train it on amplitude and phase data as two different channels?

People have tried that, but the model essentially learns to discard the phase channel because it is too hard for it to learn any useful information from it.

[deleted]

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#265

Post by godelski »

jtode wrote: post #247
haykmartiros wrote: post #59

Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…

As one of the meatsacks whose job you're about to kill... eh, I got nothin, it's damn impressive. It's gonna hit electronic music like a nuclear bomb, I'd wager.

Why do you think this will kill your job? To me this looks like an extension of the hip-hop genre.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#267

Post by itronitron »

TaupeRanger wrote: post #248
valdiorn wrote: post #18

This really is unreasonably effective. Spectrograms are a lot less forgiving of minor errors than a painting. Move a brush stroke up or down a few pixels, you probably won't notice. Move a spectral element up or down a bit and you have a completely different sound. I don't understand how this can possibly be precise enough to generate anything close to a cohesive output. Absolutely blows my mind.

It's...not effective though. Am I listening to the wrong thing here? Everything I hear from the web app is jumbled nonsense.

I think we're at the point, with these AI generative model thingies, where the practitioners are mesmerized by the mechatronic aspect like a clock maker who wants to recreate the world with gears, so they make a mechanized puppet or diorama and revel in their ingenuity.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#268

Post by gummydogg »

api wrote: post #260
spoiler wrote: post #258

Earlier quoted context omitted.

As a listener, I think you're probably still safe. Can you use this to help you though? Maybe. It's impressive what it produces, but I think it probably lacks substance in the same way the visual AI art stuff does. For the most part, it passes what I call the at-a-glanceness test. It's little better than apophenia (the same thing that makes you see shapes in clouds, faces in rocks, or think you've recognised a famili…

In general all this stuff is chopping the bottom off the market. AI art, code, writing, music, etc. can all generate passable "filler" content, which will decimate all human employment generating same. I don't think this stuff is a threat to genuinely innovative, thoughtful, meaningful work, but that's the top of the market. That being said the bottom of the market is how a lot of artists make their living, so this i…

The top of the market started at the bottom. Entry level is requiring higher and higher skills and capabilities.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#269

Post by EamonnMR »

orobinson wrote: post #234

I’d been wondering (naively) if we’d reached the point where we can’t see any new kinds of music now that electronic synthesis allows us to make any possible sound. Changes in musical styles throughout history tend to have been brought about by people embracing new instruments or technology. This is the most exciting thing I’ve seen in ages as it shows we may be on the verge of the next wave of new technology in musi…

'make any possible sound' is less important than 'make x sound easily' by way of tools and accumulated knowledge. Also what's audiences are receptive to matters a lot - you could have made noise rock in the 40s but I can't imagine it would have sold a lot of records.

Re: Riffusion – Stable Diffusion fine-tuned to generate music

#270

Post by plank »

joelrunyon wrote: post #262
haykmartiros wrote: post #59

Other author here! This got a posted a little earlier than we intended so we didn't have our GPUs scaled up yet. Please hang on and try throughout the day! Meanwhile, please read our about page http://riffusion.com/about It’s all open source and the code lives at https://github.com/hmartiro/riffusion-app --> if you have a GPU you can run it yourself This has been our hobby project for the past few months. Seeing the…

The site isn't working for me? Anything I have to fix on my side to make it work?

Crashes repeatedly on iOS in Firefox (my usual browser), is OK on Safari though, so probably not a webkit thing.
Post reply on HN