Absolutely love how readable the entire project is
Never knew Rust could be that readable. Makes me think other Rust engineers are stuck in a masochistic ego driven contest, which would explain everything else I've encountered about the Rust community and recruiting on that side.
RustGPT: A pure-Rust transformer LLM built from scratch
11–20 of 186 posts
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#12> ndarray = "0.16.1" rand = "0.9.0" rand_distr = "0.5.0" Looking good!
is this satire or does I must know context behind this comment???
Rust projects can really go bananas on dependencies, partly because it's so easy to include them
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#13Re: RustGPT: A pure-Rust transformer LLM built from scratch
#14Absolutely love how readable the entire project is
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#15Re: RustGPT: A pure-Rust transformer LLM built from scratch
#16Re: RustGPT: A pure-Rust transformer LLM built from scratch
#17[0]: https://github.com/enricozb/picogpt-rust [1]: https://jaykmody.com/blog/gpt-from-scratch/
Re: RustGPT: A pure-Rust transformer LLM built from scratch
#18Re: RustGPT: A pure-Rust transformer LLM built from scratch
#19Re: RustGPT: A pure-Rust transformer LLM built from scratch
#20As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.
the difficulty of including a dependency should be proportional to the risk you're taking on, meaning it shouldn't be as difficult as it in, say, C where every other library is continually reinventing the same 5 utilities, but also not as easy as it is with npm or cargo, because you get insane dependency clutter, and all the related issues like security, build times, etc
how good a build system isn't equivalent of how easy it is include a dependency, while modern languages should have a consistent build system, but having a centralised package repository that anyone freely pull to/from, and having those dependencies freely take on any number of other dependencies is a bad way to handle dependencies