Stable Audio Open • Hacker News Board

Re: Stable Audio Open

#21

Post by mg » Wed, Jun 05, 2024, 6:22 PM UTC

When they released Stable Audio 2.0, I tried to create "unusual" songs with prompts like "roaring dragon tumbling rocks stormy morning". The results are quite interesting:

https://www.youtube.com/@MarekGibney/videos

I find it fascinating that you can put all information needed to recreate a whole complex song into a string like

     rough stormy morning car rocks hammering
     drum solo roaring dragon downtempo
     audiosparx-v2-0 seed 5

This means a whole album of these songs could easily fit into a single TCP/IP packet.

If a music genre evolves in which each song is completely defined by its title, maybe it will be called "promptmusic".

I will try the new model with the same prompts and upload the results.

Re: Stable Audio Open

#22

Post by drivebyhooting » Wed, Jun 05, 2024, 6:23 PM UTC

From announcement I couldn’t figure out if it can do audio to audio.

Text to audio is too limiting. I’d rather input a melody or a drum beat and have the AI compose around it.

Re: Stable Audio Open

#23

Post by toenail » Wed, Jun 05, 2024, 6:34 PM UTC

rpicard wrote: post #16

rfoo wrote: post #14

Earlier quoted context omitted.

Why is Proof of Work less ethical than Proof of Rich a.k.a. rich being gradually more rich without doing anything? Not saying PoW is safer (it's not), but less ethical is pretty a bold claim.

Environmental impact of the proof of work algorithms is my understanding.

Proof of work mining is probably the only industry on the planet that has the potential to be carbon negative AND profitable.

Re: Stable Audio Open

#24

Post by Workaccount2 » Wed, Jun 05, 2024, 6:38 PM UTC

Uehreka wrote: post #11

> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have…

The idea that AI trained on artist created content is theft is kind of ridiculous anyway. Transformers aren't large archives of data with needles and thread to sew together pieces. The whole argument is meant to stifle an existential threat, not to halt some illegal transgression. If they cared about the latter a simple copyright filter on the output of the models would be all that's needed.

Re: Stable Audio Open

#25

Post by Uehreka » Wed, Jun 05, 2024, 6:39 PM UTC

rfoo wrote: post #14

Uehreka wrote: post #11

> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have…

Why is Proof of Work less ethical than Proof of Rich a.k.a. rich being gradually more rich without doing anything? Not saying PoW is safer (it's not), but less ethical is pretty a bold claim.

The environmental impact. And yes, I know, 0.5%, but my issue was always that if PoW currencies went from being a niche subculture to a point where it was used for everyday exchange (many people were arguing that this would and should happen) that 0.5% would surely go up by a great deal. To a point where crypto had to clear a super high bar of usefulness to counterbalance the harm it would do.

To be fair, AI training also has a big carbon footprint, but I feel like the utility provided by AI makes it easier to argue that its usefulness counterbalances its ecological harm.

Re: Stable Audio Open

#26

Post by [deleted] » Wed, Jun 05, 2024, 6:41 PM UTC

Uehreka wrote: post #11

> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have…

[deleted]

Re: Stable Audio Open

#27

Post by foota » Wed, Jun 05, 2024, 6:42 PM UTC

toenail wrote: post #23

rpicard wrote: post #16

Earlier quoted context omitted.

Environmental impact of the proof of work algorithms is my understanding.

Proof of work mining is probably the only industry on the planet that has the potential to be carbon negative AND profitable.

Renewable energy?

Re: Stable Audio Open

#28

Post by Uehreka » Wed, Jun 05, 2024, 6:48 PM UTC

toenail wrote: post #23

rpicard wrote: post #16

Earlier quoted context omitted.

Environmental impact of the proof of work algorithms is my understanding.

Proof of work mining is probably the only industry on the planet that has the potential to be carbon negative AND profitable.

(sigh)

Is this the methane flaring argument, or Peter Thiel’s “windmills in Vermont”?

Re: Stable Audio Open

#29

Post by JohnKemeny » Wed, Jun 05, 2024, 6:48 PM UTC

Workaccount2 wrote: post #24

Uehreka wrote: post #11

> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have…

The idea that AI trained on artist created content is theft is kind of ridiculous anyway. Transformers aren't large archives of data with needles and thread to sew together pieces. The whole argument is meant to stifle an existential threat, not to halt some illegal transgression. If they cared about the latter a simple copyright filter on the output of the models would be all that's needed.

I think you should read the case material for NY Times v OpenAI and Microsoft.

It literally says that within ChatGPT is stored, verbatim, large archives of NY Times articles and that they were able to retrieve them through their API.

Re: Stable Audio Open

#30

Post by avarun » Wed, Jun 05, 2024, 6:49 PM UTC

Uehreka wrote: post #25

rfoo wrote: post #14

Earlier quoted context omitted.

Why is Proof of Work less ethical than Proof of Rich a.k.a. rich being gradually more rich without doing anything? Not saying PoW is safer (it's not), but less ethical is pretty a bold claim.

The environmental impact. And yes, I know, 0.5%, but my issue was always that if PoW currencies went from being a niche subculture to a point where it was used for everyday exchange (many people were arguing that this would and should happen) that 0.5% would surely go up by a great deal. To a point where crypto had to clear a super high bar of usefulness to counterbalance the harm it would do. To be fair, AI training…

There is no "environmental impact". Environmental impact comes from energy production, not energy usage. It's incoherent to argue others should tamper down their energy usage because most folks producing energy aren't doing it in an ethical way.