Viewing profile — xavriley

“ We trained it from the ground up on enterprise grade, clean and commercially licensed data, without distillation from third-party models.”

I went down a similar rabbit hole at the start of my PhD and I wish I’d written more of it up. One of my theories is that they combined effects quite often. For example, “harder be…

This is cool - there’s some similar work here https://arxiv.org/pdf/2402.01571 which uses spiking neural networks (essentially Dirac pulses). I think the next step for this would b…

This is a hypothesis put forward by Gerald Langner in the last chapter of “The Neural Code of Pitch and Harmony” 2015. I personally think he was on to something but sadly he died i…

I’m the author of the high resolution guitar model posted in a comment above. I have a drum transcription model that I’m getting ready for release soon which should be state of the…

> In 1912, based on research on B vitamins, Polish biochemist Casimir Funk condensed the term vital amines to vitamines. Casimir Funk is one of the best names I’ve ever heard

Hydrofoil from Sorrento to Capri in choppy seas, on our honeymoon. Was the stuff of nightmares. My wife said we’d have to live on Capri because she was never setting foot on a boat…

It sounds like you’ve found it already but th original pYin implementation is in the VAMP plugin. Simon Dixon is my PhD supervisor but he’s quite busy. Feel free to email me questi…

High latency - agreed but it depends on whether a GPU is available or not. If it is then theoretically CREPE could be real-time. The error rates for pitch recognition are still qui…

Simple techniques like autocorrelation can still recover a missing fundamental. To answer the GP post, using neural networks for this task is overkill for simple, clean signals but…

> how does authorization between the host and the forked work? On fly.io you get a private network between machines so comms are already secure. For machines outside of fly.io it’s…

Examples are here: http://storage.googleapis.com/music2text-public/index.html

It’s not been mentioned yet, but if you play music then going to jam sessions is a great way to meet people. You’re all on a journey together toward improving as musicians which he…

There’s a model for music transcription (audio to midi) called MT3 which takes an end-to-end transformer approach and claims SOTA on some datasets. However, from my own research an…

This sort of exists already at https://classtab.org/ There's also https://www.classclef.com/ which appears to be a tidier fork of the above

Someone in my PhD lab looked at this and commented that they weren’t that impressed. The authors didn’t account for the fact that ballads and uptempo numbers have vastly different …

I agree that the install is hard on linux but there are prebuilt packages for Windows and MacOS. There's no requirement to use a Raspberry Pi. A long time ago (2017) I did successf…

For anyone wondering, a lot of work on Sonic Pi recently has gone into integrating an Elixir backend to handle distributed jamming. It has Ableton Link support so it can easily be …

I’ve got a few pieces here which aren’t all dance (e.g. live coded sampling of bass guitar) https://www.xavierriley.co.uk/talks/ @rbnpi has also done some lovey work with classical…

At the time Google Books started, “big data” was in vogue and there were data-driven ML approaches to NLP e.g. word2vec, that would have benefited from a large corpus

This is cool! I’m going to try porting this to a SuperCollider plugin at some point

There are several methods for pitch tracking of audio inputs that reach up to 99.9% accuracy on certain datasets. CREPE and pYin are just about state of the art. Granted they don’t…