VUDA: A Vulkan Implementation of CUDA • Hacker News Board

Re: VUDA: A Vulkan Implementation of CUDA

#81

Post by zamalek » Sun, Jul 02, 2023, 5:47 PM UTC

derstander wrote: post #31

iforgotpassword wrote: post #26

Earlier quoted context omitted.

This is still so mind-boggling to me. AMD should be in a good financial position now that Zen was such a success, and that their GPUs are catching up too. Why are their drivers still a Clusterfuck across the board after all these years? Why not throw more manpower at the problem? I'm sure even if their GPUs were twice as fast as Nvidia's, everybody would still buy team green because it's better to have a card that wo…

> And that use case is gaming on Windows, which supposedly is the best supported case. I’m being a little tongue-in-cheek here, but the best supported case for AMD is gaming via console: AMD provides CPU/GPU for the current generation of both the XBox and PlayStation consoles. Which suggests to me that they shouldn’t have too much problem supporting their hardware on Windows or Linux. But that’s outside of my area of…

My 6900xt is flawless for gaming on Linux (sans RT support). The big issue is other use cases.

Re: VUDA: A Vulkan Implementation of CUDA

#82

Post by jdoerfert » Sun, Jul 02, 2023, 8:19 PM UTC

scienceplease wrote: post #78

jdoerfert wrote: post #55

Earlier quoted context omitted.

Shameless plug: https://www.osti.gov/servlets/purl/1892137 TLDR; If you provide even more functions through the overloaded headers, incl. "hidden ones", e.g., `__cudaPushCallConfiguration`, you can use LLVM/Clang as a CUDA compiler and target AMD GPUs, the host, and soon GPUs of two other manufacturers.

This is really amazing work! Is it still ongoing/funded?

Yes, though with caveats. The driver and parts of the extended API we used to lower CUDA calls are in upstream LLVM. The wrapper headers are not. We will continue the process of getting it all to work in upstream/vanilla LLVM soon though. Help is always appreciated.

FWIW, we have some alternative ideas on how to get out of the vendor trap, as well as some existing prototypes to deal with things like CUBLAS and Thrust. Feel free to reach out, or just keep an eye out.

Re: VUDA: A Vulkan Implementation of CUDA

#83

Post by skocznymroczny » Tue, Jul 11, 2023, 2:43 PM UTC

netheril96 wrote: post #72

skocznymroczny wrote: post #54

Earlier quoted context omitted.

How does it work? Last time I tried DirectML it wasn't well supposed and there was little software which supported it. Also the performance seemed to be not too great. I am currently using a Linux install because with ROCm I can use popular tools like Automatic111 webui and oobabooga.

I trained a WGAN on torch-directml with no issues so the software seems quite supported. But I can’t speak of performance because I have nothing to compare against.

I gave it a try. Yeah seems like it works well on the functional side, but the performance was at least 4x slower than what ROCm on Linux gives me.