Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stable Audio Open

stability.ai

Post reply on HN
Print view View original

101–110 of 137 posts

Re: Stable Audio Open

#101

Post by MrNeon »

hierophantical wrote: post #72
bufferoverflow wrote: post #8

It produces decent audio, but something unpleasant about its high frequencies. And no voices, it doesn't seem to talk or sing. Udio, so far, is undefeated. And ElevenLabs' music demos were very very impressive, but it's still not released.

None of these are impressive in the least. Anything I have heard from Udio is basically trash. It is the AI art equivalent of synthetic cats and pretty face shots. Who cares. What is ultimately going to be undefeated is training your own model.

> What is ultimately going to be undefeated is training your own model.

From scratch?

Re: Stable Audio Open

#102

Post by jononor »

TeMPOraL wrote: post #91
mg wrote: post #21

When they released Stable Audio 2.0, I tried to create "unusual" songs with prompts like "roaring dragon tumbling rocks stormy morning". The results are quite interesting: https://www.youtube.com/@MarekGibney/videos I find it fascinating that you can put all information needed to recreate a whole complex song into a string like rough stormy morning car rocks hammering drum solo roaring dragon downtempo audiosparx-v2-…

That's a great example of the fact that information about something, say a song, isn't entirely encoded only in the medium you use to transfer it - it's partially there, and partially in the device you're using to read it! An MP3 file is just gibberish without a program that can decode it. In this case, the whole album could indeed fit into a single TCP/IP packet - because the bulk of information that make up those s…

Also note that it is the same for language. The meaning of these words are not in this text. The words are merely codes which point to things in the readers databank. And hopefully the word have similar enough associations to mine, such that the decoded message is close to what I attempted to encode...

Re: Stable Audio Open

#103

Post by jononor »

littlestymaar wrote: post #15
simonw wrote: post #6

Earlier quoted context omitted.

Sigh: Stable Audio Open is an open source text-to-audio model [...] License: https://huggingface.co/stabilityai/stable-audio-open-1.0/blo... STABILITY AI NON-COMMERCIAL RESEARCH COMMUNITY LICENSE AGREEMENT Stability are one of the worse offenders for abusing the term "open source" at the moment.

What a shame for something that could have been completely free from copyright issues given the training source… (And they're still no legal ground on such a license claim since training hardly qualify as creative process on their side)

The training data is licensed under various Creative Commons licenses. These are not in anyway "completely free of copyright issues". Most of them have specific conditions on their use.

Re: Stable Audio Open

#104

Post by jononor »

bufferoverflow wrote: post #84
genericacct wrote: post #32

Earlier quoted context omitted.

Have you tried suno? It is quite good at least for some genres

Suno is good at generating music, but its voices sound metallic with a dash of high-frequency noise. Which ruins it for me. It's almost there though, I think they will fix it in the next version.

I suspect we will get ML based "upsamplers" / enchancers / artifact removers, similar as we already have for images. That can be used to automatically post process. If they do not already exist?

Re: Stable Audio Open

#105

Post by SahAssar »

freedomben wrote: post #96
SahAssar wrote: post #53

Earlier quoted context omitted.

> Content creators are doing a purposeful slight of hand to confabulate "outputting copyrighted data" with "training on copyrighted data". I don't think so, I think it's usually argued as two different things. The "training on copyrighted data" argument is usually that we never licensed this work for this sort of use and it is different enough from previously licensed uses that it should be treated differently. The "…

> Another argument is that licensed data is whitewashed by being run through a model. So you could have GPL licensed code that is open source run through a model and then output exactly the same but because it has been outputted by the model it is considered "cleaned" from the GPL restrictions. Clearly this output should still be GPL:ed. I don't think anybody is making that argument. The NY Times claims to have gotte…

Both chatGPT and copilot will happily spit out blocks of code without any form of license. When you say "Every serious model has taken steps to prevent that sort of thing" do you mean they are hiding it or really changing the training data?

Re: Stable Audio Open

#106

Post by bufferoverflow »

jononor wrote: post #104
bufferoverflow wrote: post #84

Earlier quoted context omitted.

Suno is good at generating music, but its voices sound metallic with a dash of high-frequency noise. Which ruins it for me. It's almost there though, I think they will fix it in the next version.

I suspect we will get ML based "upsamplers" / enchancers / artifact removers, similar as we already have for images. That can be used to automatically post process. If they do not already exist?

I think the models will just get better. I mean, these already sound like professional recordings:

https://twitter.com/elevenlabsio/status/1788628175766859891

https://twitter.com/flavioschneide/status/178865450379062893...

https://twitter.com/elevenlabsio/status/1788628178786787822

https://twitter.com/elevenlabsio/status/1788628173367685281

https://twitter.com/elevenlabsio/status/1788628171044053386

https://twitter.com/flavioschneide/status/178867866121578134...

Re: Stable Audio Open

#107

Post by __loam »

Workaccount2 wrote: post #24
Uehreka wrote: post #11

> The new model was trained on audio data from FreeSound and the Free Music Archive. This allowed us to create an open audio model while respecting creator rights. This feels like the “Ethereum merge moment” for AI art. Now that there exists a prominent example with the big ethical obstacle (Proof of Work in the case of Ethereum, nonconsensual data-gathering in the case of generative AI) removed, we can actually have…

The idea that AI trained on artist created content is theft is kind of ridiculous anyway. Transformers aren't large archives of data with needles and thread to sew together pieces. The whole argument is meant to stifle an existential threat, not to halt some illegal transgression. If they cared about the latter a simple copyright filter on the output of the models would be all that's needed.

Using the product of someone's labor to build for profit systems that are trying to put them out of work remains fucked up. And no, a simple copyright filter isn't the problem. The problem is that the work was used without permission.

Re: Stable Audio Open

#108

Post by __loam »

Unai wrote: post #74
tomcam wrote: post #54

Earlier quoted context omitted.

Yet before “safeguards” were added a prompt could say “in the style of Studio Ghibli” and you could get exactly that. Would it be possible if Studio Ghibli images had not been used in the training?

I don't understand. If I make a painting (hell, or a whole animated movie) in the style of Studio Ghibli, am I infringing their copyright? I don't think so. A style is just an idea, if you want to protect an idea to the point of no one even getting inspired by it just don't let it out of your brain. If the produced work is not a copy, why does it matter if it was generated by a biological brain or by a mechanical one…

When will programmers get it through their thick skulls that an artist taking inspiration from a style and a well funded tech corporation downloading 400 million images to train on are two different things that shouldn't be compared. GPT is not a brain and humans correctly have different rights than computing systems.

Re: Stable Audio Open

#109

Post by bckr »

semi wrote: post #98
bckr wrote: post #48

Earlier quoted context omitted.

> There is no coherent data corpus (compressed or not) in ChatGPT. I disagree. If you can get the model to output an article verbatim, then that article is stored in that model. Just because it’s not stored in the same format is meaningless. It’s the same content regardless of whether it’s stored as plaintext, compressed text, PDF, png, or weights in a model. Just because you need an algorithm such as a specialized p…

>Just because you need an algorithm such as a specialized prompt to retrieve this memorized data, is also irrelevant. I disagree. Granted I'm a layman and not a lawyer so I have no clue how the court feels. But I can certainly make very specialized algorithms to produce whatever output I want from whatever input I want, and that shouldn't let me declare any input as infringing on any rights. For the reducto ad absurd…

Well, I think this is why it’s not settled yet. However, the law depends on many reasonability tests.

Re: Stable Audio Open

#110

Post by Unai »

__loam wrote: post #108
Unai wrote: post #74

Earlier quoted context omitted.

I don't understand. If I make a painting (hell, or a whole animated movie) in the style of Studio Ghibli, am I infringing their copyright? I don't think so. A style is just an idea, if you want to protect an idea to the point of no one even getting inspired by it just don't let it out of your brain. If the produced work is not a copy, why does it matter if it was generated by a biological brain or by a mechanical one…

When will programmers get it through their thick skulls that an artist taking inspiration from a style and a well funded tech corporation downloading 400 million images to train on are two different things that shouldn't be compared. GPT is not a brain and humans correctly have different rights than computing systems.

I don't know how long you have been in HN, but I would recommend you familiarise with / refresh yourself on the community guidelines (https://news.ycombinator.com/newsguidelines.html). While HN looks and works similar to Reddit (and other such online communities), the tone and culture is not the same.
Post reply on HN