Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

RustGPT: A pure-Rust transformer LLM built from scratch

github.com

Post reply on HN
Print view View original

121–130 of 186 posts

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#121

Post by OoooooooO »

mtlmtlmtlmtl wrote: post #78
ricardobeat wrote: post #32

Earlier quoted context omitted.

Have you tried uv [1]? It has removed 90% of the pain of running python projects for me. [1] https://github.com/astral-sh/uv

I'm sure it's true and all. But I've been hearing the same claim about all those tools uv is intended to replace, for years now. And every time I try to run any of those, as someone who's not really a python coder, but can shit out scripts in it if needed and sometimes tries to run python software from github, it's been a complete clusterfuck. So I guess what I'm wondering is, are you a python guy, or are you more li…

As a mainly Python guy (Data Engineering so new project for every ETL pipeline = a lot of projects) uv solved every problem I had before with pip, conda, miniconda, pipx etc.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#122

Post by Galanwe »

adastra22 wrote: post #111
Galanwe wrote: post #52

Earlier quoted context omitted.

> spent days wrestling with Python dependency hell I mean I would understand that comment in 2010, but in 2025 it's grossly ridiculous.

Yeah, because of a tool written in Rust, copying the Rust way of doing things for Python developers.

I am not even thinking of `uv`, but rather of pyproject.toml, and the various improvements as to how dependencies are declared and resolved. You don't get much simpler than a toml file listing your dependencies and constraints, along with a lock file.

Also let's keep middle school taunts at home.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#123

Post by wolvesechoes »

DiabloD3 wrote: post #54
airza wrote: post #50

Earlier quoted context omitted.

There's not really another game in town if you want to do fast ML development :/

Dunno, almost all of the people I know anywhere in the ML space are on the C and Rust end of the spectrum. Lack of types, lack of static analysis, lack of ... well, lack of everything Python doesn't provide and fights users on costs too much developer time. It is a net negative to continue pouring time and money into anything Python-based. The sole exclusion I've seen to my social circle is those working at companies…

> It, too, would benefit from becoming Rust.

Yet it was created for Python. Someone took that effort and did it. No one took that effort in Rust. End of the story of crab's superiority.

Python community is constantly creating new, great, highly usable packages that become de facto industry standards, and maintain old ones for years, creating tutorials, trainings and docs. Commercial vendors ship Python APIs to their proprietary solutions. Whereas Rust community is going through forums and social media telling them that they should use Rust instead, or that they "cheated" because those libraries are really C/C++ libraries (and BTW those should be done in Rust as well, because safety).

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#124

Post by adastra22 »

wolvesechoes wrote: post #120
adastra22 wrote: post #110

Earlier quoted context omitted.

You do know that tensorflow was written in C++ and the Python API bolted on top?

It could be written in mix of Cobol and APL. No one cares. People saying "oh those Python libraries are just C/C++ libraries with Python API, every language can have them" have one problem - no other language has them (with such extensive documentation, tutorials etc.)

Tensorflow has extensive documentation of its C++ interface, as that is the primary interface for the library (the Python API is a wrapper on top).

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#125

Post by 6r17 »

ericdotlee wrote: post #93
ramon156 wrote: post #27

Cool stuff! I can see some GPT comments that can be removed // Increased for better learning this doesn't tell me anything // Use the constants from lib.rs const MAX_SEQ_LEN: usize = 80; const EMBEDDING_DIM: usize = 128; const HIDDEN_DIM: usize = 256; these are already defined in lib.rs, why not use them (as the comment suggests)

Do you think vibe coded rust will rot the quality of language code generally?

For AI you definitely need to clean up and I think even targeted learning on some practices would be beneficiary ; for users ; it depends on the people, and I'd argue that vibe-coded rust can be better than just "written-rust" IF the important details and mind of the user are actually focused on what is important ; Eg ; I could vibe-code a lock-free well architect-ed s3 - focus on all the important details that would actually make it high perf - or write some stuff myself 10x slower - which means I will have 10 x less time to work on the important stuff.

However what you asked is wether the vibe coded rust will rot the quality of language ; this is a more difficult to answer to, but I don't think that people who are uninterested in the technics are going to go for rust anyway - from the signals I feedback people are actually not really liking it - they find it too difficult for some reason and prefer to blanket with stuff like C# or python.

Can't explain why.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#126

Post by tracker1 »

zoobab wrote: post #62
untrimmed wrote: post #16

As someone who has spent days wrestling with Python dependency hell just to get a model running, a simple cargo run feels like a dream. But I'm wondering, what was the most painful part of NOT having a framework? I'm betting my coffee money it was debugging the backpropagation logic.

"a simple cargo run feels like a dream" A cargo build that warms up your CPU during winter while recompiling the whole internet is better?

I recently upped to a 9950X with a gen5 nvme.. TBH, even installing a few programs from cargo (which does compiles) is pretty quick now. Even coming from a 5950X with a gen4 drive.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#129

Post by leoh »

ramon156 wrote: post #27

Cool stuff! I can see some GPT comments that can be removed // Increased for better learning this doesn't tell me anything // Use the constants from lib.rs const MAX_SEQ_LEN: usize = 80; const EMBEDDING_DIM: usize = 128; const HIDDEN_DIM: usize = 256; these are already defined in lib.rs, why not use them (as the comment suggests)

They should stay, because they are indicative of the fact that this wasn't built with actual understanding.

Re: RustGPT: A pure-Rust transformer LLM built from scratch

#130

Post by leoh »

tonyhart7 wrote: post #9
techsystems wrote: post #2

> ndarray = "0.16.1" rand = "0.9.0" rand_distr = "0.5.0" Looking good!

is this satire or does I must know context behind this comment???

I don't know if OP intended satire, but either way it is an absurd comment. Think about how "from scratch" this really is.
Post reply on HN