Autoregressive Language Model on the 6502 Processor
mattbeton.com
Autoregressive Language Model on the 6502 Processor
1–10 of 17 posts
Re: Autoregressive Language Model on the 6502 Processor
#2The 6502 is notoriously unfit for a C compiler, so probably there is room for more performance in the future. :)
Re: Autoregressive Language Model on the 6502 Processor
#3This is super cool!
As someone who's worked a little with NES programming and tried out cc65, I'm surprised he didn't just hand write some assembly, he likely couldve saved a lot of space if I had to guess.
Re: Autoregressive Language Model on the 6502 Processor
#4[deleted]
Re: Autoregressive Language Model on the 6502 Processor
#5This is amazing project! I hope it will result in real miniaturization of AI - for example, edge LLM inside of glasses. That will be awesome.
Re: Autoregressive Language Model on the 6502 Processor
#6Cool to think this demo would have been possible over fifty years ago. I wonder what someone from 1975 would have said if you had shown this to them back then.
Re: Autoregressive Language Model on the 6502 Processor
#7> The model weights and inference code need to be contained within 25KB of user-space memory
Wouldn’t it be era-appropriate to allow relying on banked memory? You’d still need to hold the inference code, but you could effectively stream(ing page) the weights as you compute on them.
Re: Autoregressive Language Model on the 6502 Processor
#8The biggest win for AI dev efficiency is cutting down what gets loaded into context. Semantically matching tasks to the top tools helps a lot.
Re: Autoregressive Language Model on the 6502 Processor
#9[deleted]
Re: Autoregressive Language Model on the 6502 Processor
#10[flagged]