I'm really rooting for AMD to break the CUDA monopoly. To this end, I genuinely don't know whether a translation layer is a good thing or not. On the upside it makes the hardware much more viable instantly and will boost adoption, on the downside you run the risk that devs will never support ROCm, because you can just use the translation layer. I think this is essentially the same situation as Proton+DXVK for Linux g…
AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
371–380 of 425 posts
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#372As I understand, Vulkan allows to run custom code on GPU, including the code to multiply matrices. Can one simply use Vulkan and ignore CUDA, PyTorch and ROCm?
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#373Earlier quoted context omitted.
Is this really a theory? If so my $8 AMD stock from, 2015? is currently worth $176 so they should make more shell companies they're doing great. I guess that might answer my "Why would AMD find that having a CUDA competitor isn't a business case unless they couldn't do it or the cards underperformed significantly."
For some reason AMD's GPU division continues to be run, well, horribly. The CPU division is crushing it, but the GPU division is comically bad. During the great GPU shortage AMD had multiple opportunities to capture chunks of the market and secure market share, increasing the priority for developers to acknowledge and target AMD's GPUs. What did they do instead? Not a goddamn thing, they followed Nvidia's pricing and…
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#374This event of release is however a result of AMD stopped funding it per "After two years of development and some deliberation, AMD decided that there is no business case for running CUDA applications on AMD GPUs. One of the terms of my contract with AMD was that if AMD did not find it fit for further development, I could release it. Which brings us to today." from https://github.com/vosen/ZLUDA?tab=readme-ov-file#faq…
How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…
AMD cannot keep up with arbitrarily changing hardware and software while trying to please developers that want what was just released. They would always be a generation behind at tremendous expense.
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#375Earlier quoted context omitted.
How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…
The only reason our lab bought 20k worth of Nvidia gpu cards rather than amd was the cuda industry standard (might as wellbe). It's kind of mind boggling how much business amd must be losing over this.
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#376Earlier quoted context omitted.
They would always be at the mercy of NVIDIA's API. Without knowing the inner workings, perhaps a major concern with this approach is the need to implement on NVIDIA's schedule instead of AMD's which is a very reactive stance. This approach actually would make sense if AMD felt, like most of us perhaps, that the NVIDIA ecosystem is too entrenched, but perhaps they made the decision recently to discontinue funding beca…
> They would always be at the mercy of NVIDIA's API. They only need to support PyTorch. Not CUDA
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#377Earlier quoted context omitted.
Are they ported though? I would say thanks to the Steam Deck, Proton is at a point where native Linux ports are unnecessary. It's also a much more stable target to develop against than N+1 Linux distros.
Many are specifically ported to work with Linux without a wrapper, especially among indie games and games from smaller studios. Unity, Unreal and Godot all support compiling for Linux either by default or with inexpensive or possibly free add-ons. I'm sure many other game engines do as well, and when you're taking a few hours of work at most to add everyone who owns a steam deck or a steam deck clone as a potential c…
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#378Earlier quoted context omitted.
How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…
it's a common misconception that deep learning stuff is built in cuda. it's actually built on CUDNN kernels that don't use cuda but are actually gpu assembly written by hand by phds. I'm really not convinced that this project here would be able to be used for this. the ROCm kernels that are analogue to cudnn though, yes
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#379Earlier quoted context omitted.
I know that Lina doesn't like a lot of the attention HN sends her way so it may be better if you don't link her socials here.
I think it would be better to avoid mention of them (or the Asahi project) on HN entirely, for that matter. If they don't want HN to criticize them, then they should expect to not get the free publicity that HN offers. Seems fair enough. Also, between accusing HN of "supporting trans genocide" (which is some mix between "impossible" and "false"), and poisoning links with HN referrer URLs, they don't seem like very go…
Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source
#380Earlier quoted context omitted.
I think it would be better to avoid mention of them (or the Asahi project) on HN entirely, for that matter. If they don't want HN to criticize them, then they should expect to not get the free publicity that HN offers. Seems fair enough. Also, between accusing HN of "supporting trans genocide" (which is some mix between "impossible" and "false"), and poisoning links with HN referrer URLs, they don't seem like very go…
Can you provide some context about this?