RustGPT: A pure-Rust transformer LLM built from scratch

Post by adastra22 » Mon, Sep 15, 2025, 2:57 PM UTC

Galanwe wrote: post #52

untrimmed wrote: post #16

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

> spent days wrestling with Python dependency hell I mean I would understand that comment in 2010, but in 2025 it's grossly ridiculous.

Post by yahoozoo » Mon, Sep 15, 2025, 3:09 PM UTC

adastra22 wrote: post #103

ericdotlee wrote: post #93

Earlier quoted context omitted.

Do you think vibe coded rust will rot the quality of language code generally?

These things will be corrected over time.

Post by tmaly » Mon, Sep 15, 2025, 3:25 PM UTC

ramon156 wrote: post #27

Cool stuff! I can see some GPT comments that can be removed // Increased for better learning this doesn't tell me anything // Use the constants from lib.rs const MAX_SEQ_LEN: usize = 80; const EMBEDDING_DIM: usize = 128; const HIDDEN_DIM: usize = 256; these are already defined in lib.rs, why not use them (as the comment suggests)

Post by MangoToupe » Mon, Sep 15, 2025, 3:29 PM UTC

taminka wrote: post #20

untrimmed wrote: post #16

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

lowkey ppl who praise cargo seem to have no idea of the tradeoffs involved in dependency management the difficulty of including a dependency should be proportional to the risk you're taking on, meaning it shouldn't be as difficult as it in, say, C where every other library is continually reinventing the same 5 utilities, but also not as easy as it is with npm or cargo, because you get insane dependency clutter, and a…

Post by Diggsey » Mon, Sep 15, 2025, 3:38 PM UTC

cmrdporcupine wrote: post #23

kachapopopow wrote: post #4

Earlier quoted context omitted.

I was slightly curious: cargo tree llm v0.1.0 (RustGPT) ├── ndarray v0.16.1 │ ├── matrixmultiply v0.3.9 │ │ └── rawpointer v0.2.1 │ │ [build-dependencies] │ │ └── autocfg v1.4.0 │ ├── num-complex v0.4.6 │ │ └── num-traits v0.2.19 │ │ └── libm v0.2.15 │ │ [build-dependencies] │ │ └── autocfg v1.4.0 │ ├── num-integer v0.1.46 │ │ └── num-traits v0.2.19 ( ) │ ├── num-traits v0.2.19 ( ) │ └── rawpointer v0.2.1 ├── rand v0…

linking both rand-core 0.9.0 and rand-core 0.9.3 which the project could maybe avoid by just specifying 0.9 for its own dep on it