Live data from Hacker News

RustGPT: A pure-Rust transformer LLM built from scratch

github.com

11–20 of 186 posts

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#11
post #5
post #3

Absolutely love how readable the entire project is

Never knew Rust could be that readable. Makes me think other Rust engineers are stuck in a masochistic ego driven contest, which would explain everything else I've encountered about the Rust community and recruiting on that side.

Not sure what you’re alluding to but that’s just ordinary Rust without performance or async IO concerns.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#12

> ndarray = "0.16.1" rand = "0.9.0" rand_distr = "0.5.0" Looking good!

is this satire or does I must know context behind this comment???

These are a few well-chosen dependencies for a serious project.

Rust projects can really go bananas on dependencies, partly because it's so easy to include them

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#14
post #3

Absolutely love how readable the entire project is

It is very procedural/object oriented. This is not considered good Rust practice. Iterators make it more functional, which is better, more succinct that is, and enums more algebraic. But it's totally fine for a thought experiment.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#15

> ndarray = "0.16.1" rand = "0.9.0" rand_distr = "0.5.0" Looking good!

is this satire or does I must know context behind this comment???

The project only has 3 dependencies which i interpret as a sign of quality

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#16
As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#20

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

lowkey ppl who praise cargo seem to have no idea of the tradeoffs involved in dependency management

the difficulty of including a dependency should be proportional to the risk you're taking on, meaning it shouldn't be as difficult as it in, say, C where every other library is continually reinventing the same 5 utilities, but also not as easy as it is with npm or cargo, because you get insane dependency clutter, and all the related issues like security, build times, etc

how good a build system isn't equivalent of how easy it is include a dependency, while modern languages should have a consistent build system, but having a centralised package repository that anyone freely pull to/from, and having those dependencies freely take on any number of other dependencies is a bad way to handle dependencies

Post reply on HN