Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

RustGPT: A pure-Rust transformer LLM built from scratch

github.com

Post reply on HN
Print view View original

91–100 of 186 posts

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#91

Post by surajrmal »

zoobab wrote: post #62
untrimmed wrote: post #16

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

"a simple cargo run feels like a dream" A cargo build that warms up your CPU during winter while recompiling the whole internet is better?

It has 3 direct dependencies and not too many more transitively. You're certainly not recompiling the internet. If you're going to run a local llm I doubt you're building on a toaster so build speed won't be a big ordeal either.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#93

Post by ericdotlee »

ramon156 wrote: post #27

Cool stuff! I can see some GPT comments that can be removed // Increased for better learning this doesn't tell me anything // Use the constants from lib.rs const MAX_SEQ_LEN: usize = 80; const EMBEDDING_DIM: usize = 128; const HIDDEN_DIM: usize = 256; these are already defined in lib.rs, why not use them (as the comment suggests)

Do you think vibe coded rust will rot the quality of language code generally?

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#94

Post by tinco »

mtlmtlmtlmtl wrote: post #78
ricardobeat wrote: post #32

Earlier quoted context omitted.

Have you tried uv [1]? It has removed 90% of the pain of running python projects for me. [1] https://github.com/astral-sh/uv

I'm sure it's true and all. But I've been hearing the same claim about all those tools uv is intended to replace, for years now. And every time I try to run any of those, as someone who's not really a python coder, but can shit out scripts in it if needed and sometimes tries to run python software from github, it's been a complete clusterfuck. So I guess what I'm wondering is, are you a python guy, or are you more li…

As a Ruby guy: uv makes Python feel like it finally passed the year 2010.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#95

Post by WhereIsTheTruth »

DiabloD3 wrote: post #49
ricardobeat wrote: post #32

Earlier quoted context omitted.

Have you tried uv [1]? It has removed 90% of the pain of running python projects for me. [1] https://github.com/astral-sh/uv

uv is great, but I think the real fix is just abandoning Python. The culture that language maintains is rather hostile to maintainable development, easier to just switch to Rust and just write better code by default.

abandoning Python for Rust in AI would cripple the field, not rescue it

the disease is the cargo cult addiction (which Rust is full of) to micro libraries, not the language that carries 90% of all peer reviewed papers, datasets, and models published in the last decade

every major breakthrough, from AlphaFold to Stable Diffusion, ships with a Python reference implementation because that is the language researchers can read, reproduce, and extend, remove Python and you erase the accumulated, executable knowledge of an entire discipline overnight, enforcing Rust would sabotage the field more than anything

on the topic of uv, it will do more harm than good by enabling and empowering cargo cults on a systemic level

the solution has always been education, teaching juniors to value simplicity, portability and maintainability

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#96

Post by tayo42 »

tialaramex wrote: post #77
ramon156 wrote: post #27

Cool stuff! I can see some GPT comments that can be removed // Increased for better learning this doesn't tell me anything // Use the constants from lib.rs const MAX_SEQ_LEN: usize = 80; const EMBEDDING_DIM: usize = 128; const HIDDEN_DIM: usize = 256; these are already defined in lib.rs, why not use them (as the comment suggests)

For the constants is it possible the author didn't know how? I remember in my first week of Rust I didn't understand how to name things properly, basically I was overthinking it.

From his reddit post

https://old.reddit.com/r/rust/comments/1nguv1a/i_built_an_ll...

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#97

Post by zoobab »

taminka wrote: post #66
itsibitzi wrote: post #29

Earlier quoted context omitted.

What tool or ecosystem does this well, in your opinion?

any language that has a standardised build system (virtually every language nowadays?), but doesn't have a centralised package repository, such that including a dependency is seamless, but takes a bit of time and intent i like how zig does this, and the creator of odin has a whole talk where he basically uses the same arguments as my original comment to reason why odin doesn't have a package manager

"a standardised build system (virtually every language nowadays?)"

Python packages still manage poorly dependencies that are in another lang like C or C++.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#98

Post by Narishma »

mountainriver wrote: post #80
DiabloD3 wrote: post #54

Earlier quoted context omitted.

Dunno, almost all of the people I know anywhere in the ML space are on the C and Rust end of the spectrum. Lack of types, lack of static analysis, lack of ... well, lack of everything Python doesn't provide and fights users on costs too much developer time. It is a net negative to continue pouring time and money into anything Python-based. The sole exclusion I've seen to my social circle is those working at companies…

I love Rust and C, I write quite a bit of both. I am an ML engineer by trade. To say most ML people are using Rust and C couldn’t be further from the truth

They said most people they knew, not most people.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#99

Post by llIIllIIllIIl »

tinco wrote: post #94
mtlmtlmtlmtl wrote: post #78

Earlier quoted context omitted.

I'm sure it's true and all. But I've been hearing the same claim about all those tools uv is intended to replace, for years now. And every time I try to run any of those, as someone who's not really a python coder, but can shit out scripts in it if needed and sometimes tries to run python software from github, it's been a complete clusterfuck. So I guess what I'm wondering is, are you a python guy, or are you more li…

As a Ruby guy: uv makes Python feel like it finally passed the year 2010.

Don’t forget to schedule your colonoscopy as a Ruby guy

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#100

Post by CodeMage »

taminka wrote: post #64
dev_l1x_be wrote: post #46

Earlier quoted context omitted.

> lowkey ppl who praise cargo seem to have no idea Way to go on insulting people on HN. Cargo is literally the reason why people coming to Rust from languages like C++ where the lack of standardized tooling is giant glaring bomb crater that poses burden on people every single time they need to do some basic things (like for example version upgrades). Example: https://github.com/facebook/folly/blob/main/build.sh

i'm saying that ease of dependency inclusion should not be a main criterion for evaluating how good a build system is, not that it isn't the main criterion for many people... like the entire point of my comment is that people have misguided criteria for evaluating build systems, and your comment seems to just affirm this?

Dependency management should most definitely be one of the main criteria for evaluating how good a build system is. What's misguided is intentionally opting for worse dependency management in an attempt to solve a people problem, i.e. being careless about adding dependencies to your project in circumstances when you should be careful.
Post reply on HN