Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

stability.ai

Post reply on HN
Print view View original

151–160 of 210 posts

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#151

Post by miohtama »

Applejinx wrote: post #109
iainctduncan wrote: post #102

Earlier quoted context omitted.

Midi is not lossy, midi is symbolic. There's a huge difference.

No, it's lossy. It's an event model at a fixed data rate. You can only do so many things sequentially, even if you could represent any possible musical concept as a MIDI event. So even if you're not sticking to note-on, note-off, it's still extremely lossy.

MIDI 2.0 improves a lot of things, how much dynamicity and variation you can have. MIDI 1.0 is a standard from early 80s. It indeed has shortcomings, but also the upside is editability.

It’s then for the remaster / musician / actual interpretation / post production to make the score to something less of an event model.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#152

Post by gamblor956 »

waffletower wrote: post #149
gamblor956 wrote: post #121

Earlier quoted context omitted.

MIDI is able to accommodate nearly everything that can be represented through a musical score and instrumental performance. What are you hoping to accomplish with AI-generated waveforms that can't be done with MIDI?

The problems have long been known and articulated: http://www.music.mcgill.ca/~gary/courses/papers/Moore-Dysfun...

Your example of the failures of MIDI are based on a 35-year old paper (from 1988!!!) about an earlier version of MIDI?

When that paper was written it took several weeks and many millions of dollars of equipment to render primitive, mono-color 3d graphics. Desktop computers had 512 kilobytes of RAM and the highest-end desktops 32 MB of hard drive storage space. Computer screens had two colors: black and green. Audio cards capable of making beeps and clicks were the cutting-edge. WIFI was still a decade away.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#153

Post by TylerE »

93po wrote: post #143
gabereiser wrote: post #141

Earlier quoted context omitted.

Then explain why you categorize it as cheesy? Sounds like it’s pretty cool.

he's saying the output is cheesy. it sounds like stuff you'd hear on a demo track for a kid's toy piano

It's not THAT bad, it's just that for a programming targetting jazz the playback is rather...square.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#154

Post by gamblor956 »

mdp2021 wrote: post #150
gamblor956 wrote: post #121

Earlier quoted context omitted.

MIDI is able to accommodate nearly everything that can be represented through a musical score and instrumental performance. What are you hoping to accomplish with AI-generated waveforms that can't be done with MIDI?

> What "Intention" (as a tentative term) The question becomes: what has impeded the creation of a MIDI file that can be confused with an actual concert from Arturo Benedetti Michelangeli.

Literally nothing is preventing this other than that nobody has bothered to take the time to do it.

The current version of MIDI is capable of replicating any of his performances, even down to the randomness.

Note that if you want to replicate the audio quality of his performances, you will need a high-quality MIDI instrument; the ones that ship with Windows will not suffice. These MIDI instruments can range from a few dollars to thousands of dollars. (See, e.g., Native Instruments)

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#155

Post by mdp2021 »

gamblor956 wrote: post #154
mdp2021 wrote: post #150

Earlier quoted context omitted.

> What "Intention" (as a tentative term) The question becomes: what has impeded the creation of a MIDI file that can be confused with an actual concert from Arturo Benedetti Michelangeli.

Literally nothing is preventing this other than that nobody has bothered to take the time to do it. The current version of MIDI is capable of replicating any of his performances, even down to the randomness. Note that if you want to replicate the audio quality of his performances, you will need a high-quality MIDI instrument; the ones that ship with Windows will not suffice. These MIDI instruments can range from a fe…

> nobody has bothered to take the time to do it

In such case, we have a theoretical suggestion that «nothing is preventing this», but not an actual proof based on a "Turing test"-like scenario which would have specialists fooled, to corroborate that the new MIDI 2 would suffice.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#156

Post by hofstee »

refulgentis wrote: post #139
thomashop wrote: post #128

Earlier quoted context omitted.

You are looking at a very short part of recent history. It has not been like that at all.

I'm all ears. I was "in the room" from 2019 on. Can't name one art model you could run on your GPU from a FAANG or OpenAI before SD, and can't name one LLM with public access before ChatGPT, much less weights available till LLaMA 1. But please, do share.

https://github.com/google/deepdream

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#157

Post by cosmok »

kherud wrote: post #3

Thank you for sharing! On a tangent: I'm wondering if there are any good open source models/libraries to reconstruct audio quality. I'm thinking about an end-to-end open source alternative to something like Adobe Podcast [1] to make noisy recordings sound professional. Anecdotally it's supposed to be very good. In a recent search, I haven't found anything convincing. In my naive view this tasks seems much simpler tha…

I have had a lot of success with this: https://ultimatevocalremover.com/ for de-noising

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#158

Post by visarga »

waffletower wrote: post #145
schazers wrote: post #142

Earlier quoted context omitted.

I strongly agree about generating "editables" rather than finalized media. In fact, that's why text generators are more useful than current media generators: text is editable by default. Here's a tweetstorm about it: https://x.com/jsonriggs/status/1694490308220964999?s=20

Audio is definitely editable. While generative audio is new I am hopeful that a host of interesting applications will emerge (audio2audio etc.) within its ecosystem. Promising signal separation (audio to STEMs) and pitch detection tools already exist for raw audio signals. If you want to force Stability to focus on symbolic representations (such as severely lossy MIDI) I hope you can instead first try adapting to too…

Train the model with midi notes as text in the prompt and the audio as target. It will learn to interpret notes.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#159

Post by iainctduncan »

waffletower wrote: post #148
iainctduncan wrote: post #102

Earlier quoted context omitted.

Midi is not lossy, midi is symbolic. There's a huge difference.

MIDI is an extraordinarily lossy music representation. Even Claude Shannon would facepalm at the assertion that it could, in theory, represent audio faithfully. It is not its purpose, it is decidedly not its practice, and it is a ludicrously irrelevant example of pedantry to say otherwise. The false equivalency asserted by the commons can be aggravating :D

MIDI is not a lossy format for audio because it's not a representation of audio, period. It's a format for conveying the motion of a piano keyboard, meant from the beginning to be usable for various forms of audio.

Re: Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion

#160

Post by thewataccount »

refulgentis wrote: post #139
thomashop wrote: post #128

Earlier quoted context omitted.

You are looking at a very short part of recent history. It has not been like that at all.

I'm all ears. I was "in the room" from 2019 on. Can't name one art model you could run on your GPU from a FAANG or OpenAI before SD, and can't name one LLM with public access before ChatGPT, much less weights available till LLaMA 1. But please, do share.

Openai - GPT2 2019 - https://openai.com/research/gpt-2-1-5b-release

Google - T5 - Feb 2020 - https://blog.research.google/2020/02/exploring-transfer-lear...

Both of these were and still are used heavily for on-going research and T5 has been found to be decently useful when fine-tuned.

Weights were available for both.

Post reply on HN