Rust running on every GPU
rust-gpu.github.io
Rust running on every GPU
1–10 of 211 posts
Re: Rust running on every GPU
#2> Existing no_std + no alloc crates written for other purposes can generally run on the GPU without modification.
Wow. That at first glance seems to unlock ALOT of interesting ideas.
Re: Rust running on every GPU
#3Certainly impressive that this is possible!
However, for my use cases (running on arbitrary client hardware) I generally distrust any abstractions over the GPU api, as the entire point is to leverage the low level details of the gpu. Treating those details as a nuisance leads to bugs and performance loss, because each target is meaningfully different.
To overcome this, a similar system should be brought forward by the vendors. However, since they failed to settle their arguments, I imagine the platform differences are significant. There are exceptions to this (e.g Angle), but they only arrive at stability by limiting the feature set (and so performance).
Its good that this approach at least allows conditional compilation, that helps for sure.
Re: Rust running on every GPU
#4Zig can also compile to SPIR-V. Not sure about the others.
(And I haven't tried the SPIR-V compilation yet, just came across it yesterday.)
Re: Rust running on every GPU
#5[flagged]
Re: Rust running on every GPU
#6Certainly impressive that this is possible! However, for my use cases (running on arbitrary client hardware) I generally distrust any abstractions over the GPU api, as the entire point is to leverage the low level details of the gpu. Treating those details as a nuisance leads to bugs and performance loss, because each target is meaningfully different. To overcome this, a similar system should be brought forward by th…
Exactly. Not sure why it would be better to run Rust on Nvidia GPUs compared to actual CUDA code.
I get the idea of added abstraction, but do think it becomes a bit jack-of-all-tradesey.
Re: Rust running on every GPU
#7Zig can also compile to SPIR-V. Not sure about the others. (And I haven't tried the SPIR-V compilation yet, just came across it yesterday.)
I do not get u.
Re: Rust running on every GPU
#8> Though this demo doesn't do so, multiple backends could be compiled into a single binary and platform-specific code paths could then be selected at runtime.
That’s kind of the goal, I’d assume: writing generic code and having it run on anything.
Re: Rust running on every GPU
#9Certainly impressive that this is possible! However, for my use cases (running on arbitrary client hardware) I generally distrust any abstractions over the GPU api, as the entire point is to leverage the low level details of the gpu. Treating those details as a nuisance leads to bugs and performance loss, because each target is meaningfully different. To overcome this, a similar system should be brought forward by th…
same here. I'm always hesitant to build anything commercial over abstractions, adapter or translation layers that may or may not have sufficient support in the future.
sadly in 2025, we are still in desparate need for an open standard that's supported by all vendors and that allows programming for the full feature set of current gpu hardware. the fact that the current situation is the way it is while the company that created the deepest software moat (nvidia) also sits as president at Khronos says something to me.
Re: Rust running on every GPU
#10Certainly impressive that this is possible! However, for my use cases (running on arbitrary client hardware) I generally distrust any abstractions over the GPU api, as the entire point is to leverage the low level details of the gpu. Treating those details as a nuisance leads to bugs and performance loss, because each target is meaningfully different. To overcome this, a similar system should be brought forward by th…
Exactly. Not sure why it would be better to run Rust on Nvidia GPUs compared to actual CUDA code. I get the idea of added abstraction, but do think it becomes a bit jack-of-all-tradesey.
I think the idea is to allow developers to write a single implementation and have a portable binary that can run on any kind of hardware.
We do that all the time - there are lots of code that chooses optimal code paths depending on runtime environment or which ISA extensions are available.