What's this C/C++ language?
1/++
AudioFlux: A C/C++ library for audio and music analysis
21–30 of 58 posts
Re: AudioFlux: A C/C++ library for audio and music analysis
#22Earlier quoted context omitted.
By the looks of it, those functions extract features (like frequency peaks). You do that once for a sound. The output could function as input for an NN, in which case it would be a tokenizer for sound.
Given what I've seen in audio ML research: 1) Tuning hyperparameters of your audio preprocessing is a pain if it's a preprocessed CPU step. You have to redo preprocessing every time you want to tune your audio feature hyperparams 2) It's quite common to use torchaudio spectrograms, etc. purely because they are faster (I can link to a handful of recent high-impact audio ML github repos if you like) 3) If you use nnAud…
> I can link to a handful of recent high-impact audio ML github repos if you like
Yes please :D
Re: AudioFlux: A C/C++ library for audio and music analysis
#23Earlier quoted context omitted.
C can be used in C++ code, no?
It is true that there is C code that is conforming C++ code. However I would say if you’re using a C compiler with with “extern C” in the headers for C++ linker compatibility (as this library does) then saying C++ is about as misleading as saying a Rust library is C++ as you can link to that too. As far as compatibility and “history” the languages are different enough now. There are both: features in C that do not ex…
Even Pascal is closer to C than C++ is, yet historically people use this term implying they are very close.
Re: AudioFlux: A C/C++ library for audio and music analysis
#24Do you have one in safe Rust?
See, we've only just met, and I don't know how you handle your ptr/len arguments in C just yet. ;)
Re: AudioFlux: A C/C++ library for audio and music analysis
#25Can this be used for audio fingerprinting?
Re: AudioFlux: A C/C++ library for audio and music analysis
#26Re: AudioFlux: A C/C++ library for audio and music analysis
#27Earlier quoted context omitted.
Given what I've seen in audio ML research: 1) Tuning hyperparameters of your audio preprocessing is a pain if it's a preprocessed CPU step. You have to redo preprocessing every time you want to tune your audio feature hyperparams 2) It's quite common to use torchaudio spectrograms, etc. purely because they are faster (I can link to a handful of recent high-impact audio ML github repos if you like) 3) If you use nnAud…
> I can link to a handful of recent high-impact audio ML github repos if you like Yes please :D
For instance:
https://github.com/descriptinc/descript-audio-codec/blob/mai...
https://github.com/NVIDIA/BigVGAN/blob/main/loss.py#L23
https://arxiv.org/pdf/2210.13438 (the github repo doesn't include training, just inference)
It is INCREDIBLY common to use multi-scale spectral loss as the audio distance / objective measure in audio generation. They have some issues (i.e. they aren't always well correlated with human perception) but they are the known-current-best.
Re: AudioFlux: A C/C++ library for audio and music analysis
#28Earlier quoted context omitted.
By the looks of it, those functions extract features (like frequency peaks). You do that once for a sound. The output could function as input for an NN, in which case it would be a tokenizer for sound.
Given what I've seen in audio ML research: 1) Tuning hyperparameters of your audio preprocessing is a pain if it's a preprocessed CPU step. You have to redo preprocessing every time you want to tune your audio feature hyperparams 2) It's quite common to use torchaudio spectrograms, etc. purely because they are faster (I can link to a handful of recent high-impact audio ML github repos if you like) 3) If you use nnAud…
Backpropping filter coefficients sounds clever, but can't you just do that on any layer that takes a spectrum as input?
Re: AudioFlux: A C/C++ library for audio and music analysis
#29So are they going for feature parity with librosa? I think that would be great.
Re: AudioFlux: A C/C++ library for audio and music analysis
#30It would be nice to have a comparison with any of the many C++ MIR (music information retrieval) libraries in the wild: - https://essentia.upf.edu/ - https://github.com/marsyas/marsyas - https://github.com/ircam-ismm/pipo - https://github.com/flucoma/flucoma-core/tree/main/include/al...
If a person wanted to transcribe sheet music from recorded audio, do you know which library and features would be the best starting point?