As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.
lowkey ppl who praise cargo seem to have no idea of the tradeoffs involved in dependency management the difficulty of including a dependency should be proportional to the risk you're taking on, meaning it shouldn't be as difficult as it in, say, C where every other library is continually reinventing the same 5 utilities, but also not as easy as it is with npm or cargo, because you get insane dependency clutter, and a…
RustGPT: A pure-Rust transformer LLM built from scratch
31–40 of 186 posts
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#32As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#33Re: RustGPT: A pure-Rust transformer LLM built from scratch
#34Re: RustGPT: A pure-Rust transformer LLM built from scratch
#35Its a very cool excercise, I did the same with Zig and MLX a while back, so I can get a nice foundation, but since then as I got hooked and kept adding stuff to it, switched to Pytorch/Transformers.
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#36Earlier quoted context omitted.
I know because this is how an AI generated project looks. Clearly AI generated README, "clean" code, the way files are named, etc.
To me it looks like LLM generated README, but not necessarily the source (or at least not all of it). Or there's been a cleaning pass done over it.
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#37Earlier quoted context omitted.
How do you know? The over-commenting?
I know because this is how an AI generated project looks. Clearly AI generated README, "clean" code, the way files are named, etc.
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#38Absolutely love how readable the entire project is
Never knew Rust could be that readable. Makes me think other Rust engineers are stuck in a masochistic ego driven contest, which would explain everything else I've encountered about the Rust community and recruiting on that side.
But most people aren't writing libraries.
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#39I’m curious where you got your training data? I will look myself, but saw this and thought I’d ask. I have a CPU-first, no-backprop architecture that works very well on classification datasets. It can do single‑example incremental updates which might be useful for continuous learning. I made a toy demo to train on tiny.txt and it can predict next characters, but I’ve never tried to make an LLM before. I think my arch…
https://huggingface.co/datasets/NousResearch/Hermes-3-Datase...
For just plain text, I really like this one - https://huggingface.co/datasets/roneneldan/TinyStories
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#40Congrats - there is a very small problem with the LLM - its reusing transformer blocks and you want to use different instances of them. Its a very cool excercise, I did the same with Zig and MLX a while back, so I can get a nice foundation, but since then as I got hooked and kept adding stuff to it, switched to Pytorch/Transformers.