Live data from Hacker News

Show HN: I trained a 125M model to autocomplete piano on-device

simedw.com

41–50 of 135 posts

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#41

Running a 125M model on-device at that speed is impressive. How much did you have to optimize the model to get that performance on an iPhone?

The biggest speed improvement came from changing the note representation when I switched to compound note events: roughly 5× fewer autoregressive passes per note.

For the current model I’m using Core ML, which optimizes the kernels the first time you run it. I haven’t actually spent that much time tuning performance beyond that.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#42
post #33

Ah, MIDI files. The only type of music you could realistically download from the internet back in the day, and you had to wake up at ungodly hours so that your dialup modem would not rack up a massive phone bill.

MIDI is still widely used for professional music production. It sounded goofy back in the day because synthesizer it was played on was not very good.

I'm thinking canyon.mid on Microsoft GS Wavetable Synth.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#44
post #33

Ah, MIDI files. The only type of music you could realistically download from the internet back in the day, and you had to wake up at ungodly hours so that your dialup modem would not rack up a massive phone bill.

I remember downloading MOD files. It was just a bit larger than midi, but sounded better. I had a PC but I think it was an Amiga thing

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#46

Running a 125M model on-device at that speed is impressive. How much did you have to optimize the model to get that performance on an iPhone?

The answer about changing the note representation was interesting. Sometimes a change in how the problem is represented ends up giving a much bigger improvement than trying to optimize the model itself.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#47

This is really fun. Scaler 3 starts with a chord progression and lets you break it down into musical performances and parts. Useful for ideation when producing. Would be fun to get a midi clock going and play some chords on my piano and have my synth start jamming along with the bass and my keyboard doing some performance. Or any combination of the above.

That would be a really interesting direction. At that point it starts feeling less like autocomplete and more like having another musician reacting to what you're playing in real time.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#49

I would love something like that, except that I play the melody, and it produces proper 3-4 part accompaniment, preferably in good baroque style. Extra bonus if it could also write it into a file in a format suitable for music editing programs.

This feels like a natural next step. Starting with a simple melody and having the system fill in the rest while still following your playing style could make it much more useful for experimentation than generating a complete piece from scratch.
Post reply on HN