Live data from Hacker News

Show HN: I trained a 125M model to autocomplete piano on-device

simedw.com

51–60 of 135 posts

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#51
I think this is a great project and very HN. Not sure why the comments are so focused on the deliverable- you learned way more and had a much more interesting experience.

One think I didn't see mentioned in the post- maybe I missed it- how large was the data? How many samples did you use to pretrain and post-train

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#52
Oh, a cool idea! I just tried it, works pretty well. Kudos!

One feature request:

Instead of playing the AI-generated audio solely through the iPhone's speakers, add an option to send the audio as midi notes to a device (probably the same one you received the mini notes from).

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#53
post #33

Ah, MIDI files. The only type of music you could realistically download from the internet back in the day, and you had to wake up at ungodly hours so that your dialup modem would not rack up a massive phone bill.

MIDI is still widely used for professional music production. It sounded goofy back in the day because synthesizer it was played on was not very good.

I remember at one point RuneScape switched from the built in Microsoft midi whatever to their own sound engine, and from that day, everything sounded wrong, even the frogs, because to me, the crappy midi sounds were the whole personality and feel of the game.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#54
post #44
post #33

Ah, MIDI files. The only type of music you could realistically download from the internet back in the day, and you had to wake up at ungodly hours so that your dialup modem would not rack up a massive phone bill.

I remember downloading MOD files. It was just a bit larger than midi, but sounded better. I had a PC but I think it was an Amiga thing

Need For Madness is one of my favorite games, and probably two thirds of that fondness is the music, which was a bunch of MOD files.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#57
Interesting. I do feel letting a machine generating notes is taking the joy out of improvisation, is it not?

I think one of the great, early, joys of learning a piano is gaining the following intuitions: The seemingly harder path of learning sheet is actually faster. Your mind _should_ learn to think in two dimensions Spatial — where fingers go — and Time — pitch and tempo – ** when learning. The _internalization_ of Space and Time queues guide the fingers in a dance that is vastly satisfying. This skill leads you to the final part of the journey that is improvisation and the one more exciting than what i am on now.

---

**

Space: Your finger placement on keys right, e.g. knowing how to go from landmark/anchor notes(mid-c, G, F etc) and then go to the others above and below it. Crudely this is some what like typing from your landmark f and j qwerty keyboard

Time: The out singing/verbalizing of the notes/beats on a time measure as you play them(per the time measure). e.g. you can say out loud 1-2-3-4 for 4/4 measure, if the measure has quarter notes say out loud. And `1-e-and-a-2-e-and-a-3-e-and-a-4-e-and-a` for a 4/4 with 1/16th note granularity. Do this as you play the notes and you get a sense of tempo.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#59
post #3

[flagged]

Is this HN? Aren't people supposed to tinker with tech for no reason other than seeing if they can? Is everything that involves a transformer now just AI BAD? Is that what the world has devolved into? Each side screaming "Orange Man Bad" and endless variations at each other?

>orange man bad

You know, I was nodding along until you shoehorned that one in.

Re: Show HN: I trained a 125M model to autocomplete piano on-device

#60

Would you be willing to share about how much it cost to train a model like this?

Luckily I have access to 4x RTX 4090s, so I didn’t have to pay cloud GPU prices directly. If I had, it probably would have added up quite a bit given how many training runs and experiments I ended up doing.
Post reply on HN