Live data from Hacker News

Show HN: I trained a 125M model to autocomplete piano on-device

simedw.com

121–130 of 135 posts

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#121

This sort of “autocomplete” is actually fundamental to how classical composers were trained. For anyone interested, I’d highly recommend reading Robert Gjerdingen’s article Gebrauchs-Formulas. https://www.researchgate.net/publication/259731561_Gebrauchs... You can also listen to the transcript of four Russian composers, including Rachmaninoff, playing this pattern recognition and generation game at a dinner party in…

Probably the last truly great classical improviser on piano was Anton Rubinstein (1829-1894). His Fantaisie in E minor, Op. 77 is probably the pinnacle of his skill in (notated) improvisation.

After that, the great classical improvisers were probably organists in the 20th century, like Marcel Dupré (1886-1971) and Pierre Cochereau (1924-1984). Cochereau created vast, highly personal, symphonic forms with dazzling orchestral registration.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#122

The results strike me as comparable or worse than you could get with a Markov model. I think it reveals the gap in understanding between LLMs and music. I think you need to either: - Set up a pipeline to decompose music into, say, harmonic sequences and melodic sequences, and then have the LLM work on some more fundamental or more high-level layer of musical composition and then re-translate it back into actual sound…

I'm not at all there yet, but this sort of thing is on my roadmap for my AI music project at tunesage.com ... That is, generating musical ideas while being conscious of phrase / melodic / thematic structure that a user can then play around with.

While LLMs (and ANNs in general) are definitely great for musical analysis (though still limited), I think they're likely overkill for the generation part, plus they tend to suffer from "creative collapse" as they prefer averages rather than exploration (which can be good or bad depending on what you want).

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#124
The end of the AI's first sub-phrase in the video is wrong.

You started by playing a simple I - vii - I as the first sub-phrase. Then the AI started its response with a dominant 7th-chord. In the vast majority of cases I can think of from the Classical era, the AI's sub-phrase would end with a half-cadence. So, including what you played, the first two sub-phrases would look like this:

I - vii - I

V(7) - I - V

But instead, the AI took the unusual step of having a full cadence for that 2nd sub-phrase. This in music is what someone might call a "double beat" in screenwriting.

Moreover, there are no half cadences in the phrase after that. It's all full cadences in the tonic key, plus two plagal cadences over a tonic pedal there in the 2nd phrase. Each sub-phrase just extends the tonic. There are idiomatic ways to just stay in the tonic for awhile, like "Horn fifths." But this excerpt isn't idiomatic and sounds like the composer accidentally forgot to develop the harmony.

I'm going to claim that this excerpt would sound like the musical equivalent of a run-on sentence to any composer who lived from the time of J.S. Bach to Robert Schumann. And from Mahler on they'd assume you're thumbing your nose at convention.

Put another way: the kind of student who'd use this to finish a harmony exercise would end up getting the same grade they would have gotten doing it on their own.

Edit: clarifications

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#126
This is amazing. Great inspiration to train a model for a midi electric guitar solo. Though with bends, vibratos, mutes, harmonics, dive bombs etc as part of the event feed, it may possibly create way more events than this which means more training I suppose.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#127

I would love something like that, except that I play the melody, and it produces proper 3-4 part accompaniment, preferably in good baroque style. Extra bonus if it could also write it into a file in a format suitable for music editing programs.

Did you ever try Ludwig? It was rule-based by the Fritz chess engine maker. To my understanding Ludwig was grounded in traditional harmony, counterpoint, voice-leading, and orchestration principles taught in formal music education. It never took off so they eventually stopped it.

Some details: https://shop.chessbase.com/en/products/ludwig_3_engl

You can still download it for free: https://www.heise.de/download/product/ludwig-58854 (Heise is a renowned German publisher, nothing shady)

I am still waiting for something like this based on generaitive AI.

Post reply on HN