Viewing profile — gizmo64k

You are right. I was too close to see the gap. You did the work I should have done upfront. I revised the article. Thanks for the feedback.

[dead]

Thanks! The training corpus and code are in the repo if you want to try... Training takes just a couple of minutes on an RTX 3090. Don't get your hopes up too high, though. I can i…

..and we would keep the human in the loop:)

Believe me, using the 1541 as co-processor and extra storage was super tempting and on my mind all the time! So what do you think? Flash attention with K on the front side and V on…

I am the subject of your investigation. So, in your world meta-programming is a bad thing? Fine. In my world it isn't. The transition layers are how I kept four implementations bit…