Live data from Hacker News

AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

phoronix.com

371–380 of 425 posts

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#371

I'm really rooting for AMD to break the CUDA monopoly. To this end, I genuinely don't know whether a translation layer is a good thing or not. On the upside it makes the hardware much more viable instantly and will boost adoption, on the downside you run the risk that devs will never support ROCm, because you can just use the translation layer. I think this is essentially the same situation as Proton+DXVK for Linux g…

Try with ComfyUI... works great and easy setup on my 6750XT. I've had it working for about a year now with SD, LlamaCpp and WhisperCpp.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#372

As I understand, Vulkan allows to run custom code on GPU, including the code to multiply matrices. Can one simply use Vulkan and ignore CUDA, PyTorch and ROCm?

there's a pretty cool Vulkan LLM engine here for example:

https://github.com/mlc-ai/mlc-llm

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#373
post #191

Earlier quoted context omitted.

Is this really a theory? If so my $8 AMD stock from, 2015? is currently worth $176 so they should make more shell companies they're doing great. I guess that might answer my "Why would AMD find that having a CUDA competitor isn't a business case unless they couldn't do it or the cards underperformed significantly."

For some reason AMD's GPU division continues to be run, well, horribly. The CPU division is crushing it, but the GPU division is comically bad. During the great GPU shortage AMD had multiple opportunities to capture chunks of the market and secure market share, increasing the priority for developers to acknowledge and target AMD's GPUs. What did they do instead? Not a goddamn thing, they followed Nvidia's pricing and…

Does this have anything to do with AMD's GPU division being a result of an acquisition (ATI)?

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#374

This event of release is however a result of AMD stopped funding it per "After two years of development and some deliberation, AMD decided that there is no business case for running CUDA applications on AMD GPUs. One of the terms of my contract with AMD was that if AMD did not find it fit for further development, I could release it. Which brings us to today." from https://github.com/vosen/ZLUDA?tab=readme-ov-file#faq…

How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…

Nvidia controls CUDA the software spec, Nvidia also controls the hardware CUDA runs on. The industry adopts CUDA standards and uses the latest features.

AMD cannot keep up with arbitrarily changing hardware and software while trying to please developers that want what was just released. They would always be a generation behind at tremendous expense.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#375

Earlier quoted context omitted.

How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…

The only reason our lab bought 20k worth of Nvidia gpu cards rather than amd was the cuda industry standard (might as wellbe). It's kind of mind boggling how much business amd must be losing over this.

Your “lab” does not sound like a lab in the classical sense.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#376
post #11

Earlier quoted context omitted.

They would always be at the mercy of NVIDIA's API. Without knowing the inner workings, perhaps a major concern with this approach is the need to implement on NVIDIA's schedule instead of AMD's which is a very reactive stance. This approach actually would make sense if AMD felt, like most of us perhaps, that the NVIDIA ecosystem is too entrenched, but perhaps they made the decision recently to discontinue funding beca…

> They would always be at the mercy of NVIDIA's API. They only need to support PyTorch. Not CUDA

AMD should be able to pay for two teams. They had a decent growth period recently. Doing one doesn't stop them from doing the other.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#377

Earlier quoted context omitted.

Are they ported though? I would say thanks to the Steam Deck, Proton is at a point where native Linux ports are unnecessary. It's also a much more stable target to develop against than N+1 Linux distros.

Many are specifically ported to work with Linux without a wrapper, especially among indie games and games from smaller studios. Unity, Unreal and Godot all support compiling for Linux either by default or with inexpensive or possibly free add-ons. I'm sure many other game engines do as well, and when you're taking a few hours of work at most to add everyone who owns a steam deck or a steam deck clone as a potential c…

They do, yet you will hardly find a big name Studio that will waste additional money doing builds, QA and customer support for GNU/Linux, just let Valve do the needful with Proton.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#378
post #315

Earlier quoted context omitted.

How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…

it's a common misconception that deep learning stuff is built in cuda. it's actually built on CUDNN kernels that don't use cuda but are actually gpu assembly written by hand by phds. I'm really not convinced that this project here would be able to be used for this. the ROCm kernels that are analogue to cudnn though, yes

This project relies on ROCm for all it's CUDNN magic.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#379
post #261

Earlier quoted context omitted.

I know that Lina doesn't like a lot of the attention HN sends her way so it may be better if you don't link her socials here.

I think it would be better to avoid mention of them (or the Asahi project) on HN entirely, for that matter. If they don't want HN to criticize them, then they should expect to not get the free publicity that HN offers. Seems fair enough. Also, between accusing HN of "supporting trans genocide" (which is some mix between "impossible" and "false"), and poisoning links with HN referrer URLs, they don't seem like very go…

Can you provide some context about this?

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#380
post #379

Earlier quoted context omitted.

I think it would be better to avoid mention of them (or the Asahi project) on HN entirely, for that matter. If they don't want HN to criticize them, then they should expect to not get the free publicity that HN offers. Seems fair enough. Also, between accusing HN of "supporting trans genocide" (which is some mix between "impossible" and "false"), and poisoning links with HN referrer URLs, they don't seem like very go…

Can you provide some context about this?

Found some... Seems crazy to me; this community has never felt transphobic to me... https://news.ycombinator.com/item?id=36226845
Post reply on HN