Real-time audio feature extraction with the Web Audio API

#1

Post by codeoclock » Wed, Dec 17, 2014, 11:46 PM UTC

Real-time audio feature extraction with the Web Audio API
github.com

Re: Real-time audio feature extraction with the Web Audio API

#2

Post by jonjoe » Wed, Dec 17, 2014, 11:52 PM UTC

Bump!

Re: Real-time audio feature extraction with the Web Audio API

#3

Post by danra » Thu, Dec 18, 2014, 1:19 AM UTC

If you are into this, also check out Sonic Visualizer (http://www.sonicvisualiser.org), with its support for VAMP plug-ins for analyzing audio.

Re: Real-time audio feature extraction with the Web Audio API

#4

Post by diydsp » Thu, Dec 18, 2014, 1:52 AM UTC

Excellent.

I've hosted hughrawlinson's demo code at http://diydsp.com/fun/meyda/

And I've written a short blogpost teaching people what-the-heck feature extraction is at http://diydsp.blogspot.de/2014/12/javascript-audio-feature-e...

Re: Real-time audio feature extraction with the Web Audio API

#5

Post by diydsp » Thu, Dec 18, 2014, 1:55 AM UTC

danra wrote: post #3

If you are into this, also check out Sonic Visualizer ( http://www.sonicvisualiser.org ), with its support for VAMP plug-ins for analyzing audio.

Ah yes, Sonic Visualizer is an incredible tool. Despite the name which might sound like merely a trippy thing to watch, it can be used for extremely serious work, such as reverse-engineering world music scales, tuning instruments, figuring out and annotating the notes in a song, etc.

Note #1. The VAMP plug-ins seriously kick up the power of Sonic Visualizer and that they are open-source and used in the also amazing online tool Chordify which is found at http://chordify.net

Note #2. Chordify is a neat tool which automatically extracts the chords from any youtube video you point at it. It's free, but if you pay an additional 50 cents or so, it will send a you a rudimentary MIDI file with the chords in it. It's been worth it for me several times already.

Re: Real-time audio feature extraction with the Web Audio API

#6

Post by codeoclock » Thu, Dec 18, 2014, 2:08 AM UTC

diydsp wrote: post #4

Excellent. I've hosted hughrawlinson's demo code at http://diydsp.com/fun/meyda/ And I've written a short blogpost teaching people what-the-heck feature extraction is at http://diydsp.blogspot.de/2014/12/javascript-audio-feature-e...

Thanks for the exposure!

The demo is also available at http://hughrawlinson.github.io/meyda.

I also want to be very clear from the outset that this was a group effort between @nevosegal, @jakubfiala (on github) and myself. We've contributed equally to the source, the research, the testing, and the accompanying paper that has been accepted for presentation at the first Web Audio Conference in Paris.