Rust for GPU programming? My CUDA debugging sessions just got a whole lot less painful, hopefully.
Nvidia announces native GPU programming in Rust
71–80 of 321 posts
Re: Nvidia announces native GPU programming in Rust
#72> The launch is checked rather than trusted. Damn even Nvidia is putting out fully Claude-written articles.
What are we for, I ask? What the hell are we now. Chatters to LLMs now? Is this our future? It really is starting to feel like it now.
Dude I am in slop fucking hell right now. There is still room for a human touch, without which the agents will lever us harder and faster into a world of incomprehensible garbage.
Re: Nvidia announces native GPU programming in Rust
#73I strongly dislike CUDA. Once you have allowed that proprietary cr*p into your C++ codebase, it is very hard to get rid, and you end up with code that is either tied to a single vendor or an #ifdef hell, probably both. The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually, like in Metal, OpenCL, and D3D12, e…
Launching kernels manually is an error prone PITA which I believe is the principle reason for CUDA's popularity. Having the compiler give an error when you mess up is a huge benefit. But having the compiler allow you to express "I want to launch this kernel over a grid with these dimensions, with these arguments" as a single expression is where the vast majority of the value comes from.
The having it all in a single file is mostly an artefact of the fact that it is C++, because C++ is single file at a time compilation. In D (which is multiple files in a single compiler invocation) with DCompute (which targets CUDA and OpenCL with upcoming support for Vulkan and Metal), you are required to write the kernels in a separate module, but you get all the benefits of the compiler complaining when you mess up _and_ the expressivity of "launch me this kernel".
Re: Nvidia announces native GPU programming in Rust
#74> The launch is checked rather than trusted. Damn even Nvidia is putting out fully Claude-written articles.
> even Nvidia Why "even Nvidia"? They are fully behind using AI for basically everything. What's next? "Damn, even McDonald's is putting out unhealthy food"
I think implication being organizations with 40,000+ employees and even more consultants and contractors plus a lot of budget are also using LLMs to draft public facing content instead of paying for content writers or even just proof readers .
It points to friction rather than cost economics. Same reason we are always surprised why multi billion dollar product companies with millions of install base prefer electron instead of a native app.
Re: Nvidia announces native GPU programming in Rust
#75Earlier quoted context omitted.
> I strongly dislike CUDA. Once you have allowed that proprietary cr*p Genuine question...why not just type "crap"? It's not even that much of a curse, but I've never really understood the point of self-censorship. If you don't want to curse then you could just use a non-curse word.
It may be to bypass censorship, rather than self-censorship. Some platforms block or shadowban comments with curse words. Not sure about this platform.
HN definitely doesn't give a crap about that word.
Re: Nvidia announces native GPU programming in Rust
#76> The launch is checked rather than trusted. Damn even Nvidia is putting out fully Claude-written articles.
That's actually a magnificent observation. This is not only an indication of a keen eye, but a trained brilliant mind as well.
One might even say it is load-bearing on the seam!
Re: Nvidia announces native GPU programming in Rust
#77Earlier quoted context omitted.
What are we for, I ask? What the hell are we now. Chatters to LLMs now? Is this our future? It really is starting to feel like it now.
Dude I am in slop fucking hell right now. There is still room for a human touch, without which the agents will lever us harder and faster into a world of incomprehensible garbage.
I totally concur. I'm almost lost for words at this stage. I need me some land to grow vegetables on and that's about it. Maybe some chickens. Every single day brings more despair (and not the prosperity we were promised).
Re: Nvidia announces native GPU programming in Rust
#78Earlier quoted context omitted.
Nobody cares if kernels are written in Rust. Kernels were meant to be written in C, but if you want to go more high-level try Triton or a similar DSL that nicely abstract tile sizes etc.
kernels aren't meant to be written by any defined language. C is just a traditionally good default language that took over from assembly. No particular reason we have to stick with C.
And quite a few reasons that something better than C should be used. Rust seems a good candidate.
Re: Nvidia announces native GPU programming in Rust
#79Earlier quoted context omitted.
not to worry, they have an 'AI generated summary' box too
Its a recursive summarization pyramid
It gets fun when someone uses an uncensored model to bypass a refusal, but they accidentally pick one that was trained for erotic writing and brings its particular talent to the documentation task.
Re: Nvidia announces native GPU programming in Rust
#80> The launch is checked rather than trusted. Damn even Nvidia is putting out fully Claude-written articles.
> even Nvidia Why "even Nvidia"? They are fully behind using AI for basically everything. What's next? "Damn, even McDonald's is putting out unhealthy food"
I believe most of their marketing videos use fairly convincing text to speech too, not voice actors.