Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

phoronix.com

Post reply on HN
Print view View original

341–350 of 425 posts

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#341

Post by bongodongobob »

swozey wrote: post #185

I may have missed it in the article, but this post would mean absolutely nothing to me except for the fact that last week I got into stable diffusion so I'm crushing my 4090 with pytorch and deepspeed, etc and dealing with a lot of nvidia ctk/sdk stuff. Well, I'm actually trying to do this in windows w/ wsl2 and deepmind/torch/etc in containers and it's completely broken so not crushing currently. I guess awhile ago…

Just run that stuff in Linux, you're making it harder than it needs to be. Can it work in Windows? Sure. Is there as much documentation? Not even close.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#342

Post by washadjeffmad »

Cu3PO42 wrote: post #270
bntyhntr wrote: post #228

Earlier quoted context omitted.

I would love to be able to have a native stable diffusion experience, my rx 580 takes 30s to generate a single image. But it does work after following https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki... I got this up and running on my windows machine in short order and I don't even know what stable diffusion is. But again, it would be nice to have first class support to locally participate in the fun.

I have heard that DirectML was a somewhat easier story, but allegedly has worse performance (and obviously it's Windows only...). But I'm not entirely suprised that setup is somewhat easier on Windows, where bundling everything is an accepted approach. With AMD's official 15GB(!) Docker image, I was now able to get the A1111 UI running. With SD 1.5 and 30 sample iterations, generating an image takes under 2s. I'm sti…

That has to include the model(s), no?

Also, nothing is easier on Windows. It's a wonder that anything works there, except for the power of recalcitrance.

Not dogging Windows users, but once your brain heals, it just can't go back.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#343

Post by leeoniya »

smcl wrote: post #261
leeoniya wrote: post #179

Earlier quoted context omitted.

fertile soil for Alyssa and Asahi Lina :) https://rosenzweig.io/ https://vt.social/@lina

I know that Lina doesn't like a lot of the attention HN sends her way so it may be better if you don't link her socials here.

pretty sure she's a vt.social admin, so she can always do what jwz does with HN referer headers :D

given how omnipresent she is with her live streaming, it's a bit like South Park's Worldwide Privacy Tour: https://www.youtube.com/watch?v=2N8_5LDkZwY

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#344

Post by Modified3019 »

pheatherlite wrote: post #316
tgsovlerkhgsel wrote: post #313

Earlier quoted context omitted.

How is this not priority #1 for them, with NVIDIA stock shooting to the moon because everyone does machine learning using CUDA-centric tools? If AMD could get 90% of the CUDA ML stuff to seamlessly run on AMD hardware, and could provide hardware at a competitive cost-per-performance (which I assume they probably could since NVIDIA must have an insane profit margin on their GPUs), wouldn't that be the opportunity to e…

The only reason our lab bought 20k worth of Nvidia gpu cards rather than amd was the cuda industry standard (might as wellbe). It's kind of mind boggling how much business amd must be losing over this.

That was a good decision. The amount of lamenting engineers I’ve seen over the years who’ve been given the task of trying to get more affordable AMD cards to work with enterprise functionality is nontrivial. AMD nearly borders on hostility with its silence, even if you want to throw millions at them, it’s insane.

At least Nvidia, which I fucking hate, will happily hold out their hand for cash even from individuals.

So now we’re in a hilarious situation where people from hobbyists to enterprise devs are hoping for intel to save the day.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#345

Post by coderenegade »

bluedino wrote: post #248
bick_nyers wrote: post #162

Earlier quoted context omitted.

The latest version of CUDA is 12.3, and version 12.2 came out 6 months prior. How many people are running an older version of CUDA right now on NVIDIA hardware for whatever particular reason? Even if AMD lagged support on CUDA versioning, I think it would be widely accepted if the performance per dollar at certain price points was better. Taking the whole market from NVIDIA is not really an option, it's better to att…

> How many people are running an older version of CUDA right now on NVIDIA hardware for whatever particular reason? I would guess there are lots of people still running CUDA 11. Older clusters, etc. A lot of that software doesn't get updated very often.

Especially if you're deploying models. The latest version of onnx runtime still defaults to cuda 11.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#346

Post by paulmd »

Rafuino wrote: post #327
pheatherlite wrote: post #316

Earlier quoted context omitted.

The only reason our lab bought 20k worth of Nvidia gpu cards rather than amd was the cuda industry standard (might as wellbe). It's kind of mind boggling how much business amd must be losing over this.

So, your lab bought ~1 GPU?

or a rack of 3090s/4090s or quadros

(the "no datacenter" clause obviously excludes workstations, and the terms of this license cannot be applied to the open kernel driver since it's GPL'd)

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#347

Post by paulmd »

weebull wrote: post #296
whywhywhywhy wrote: post #215

Earlier quoted context omitted.

> I'm really rooting for AMD to break the CUDA monopoly Personally I want Nvidia to break the x86-64 monopoly, with how amazing properly spec'd Nvidia cards are to work with I can only dream of a world where Nvidia is my CPU too.

> Personally I want Nvidia to break the x86-64 monopoly The one supplied by two companies?

"minor spelling/terminology mistake, activate the post-o-tron"

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#348

Post by bitbang »

RachelF wrote: post #329
Keyframe wrote: post #173

This event of release is however a result of AMD stopped funding it per "After two years of development and some deliberation, AMD decided that there is no business case for running CUDA applications on AMD GPUs. One of the terms of my contract with AMD was that if AMD did not find it fit for further development, I could release it. Which brings us to today." from https://github.com/vosen/ZLUDA?tab=readme-ov-file#faq…

Yeah, AMD look like idiots for doing this. Either they are very stupid, or open sourcing the library stops NVidia from suing them in a repeat of the Oracle/Google lawsuit over Java APIs? I'm not sure what the reason is?

That was my immediate thought: the software is made publicity available to help add value to their product offering, but they plausable deniability in court and don't have to bear the burden of potential lawsuits or support.

Re: AMD funded a drop-in CUDA implementation built on ROCm: It's now open-source

#349

Post by paulmd »

Keyframe wrote: post #319
weebull wrote: post #296

Earlier quoted context omitted.

> Personally I want Nvidia to break the x86-64 monopoly The one supplied by two companies?

Maybe he meant homogeneity which Nvidia did try and tries with Arm.. but, on the other hand how wild would it be for Nvidia to enter x86-64 as well? It's probably never going to happen due to licensing if nothing else, lest we remember nForce chipset ordeal with intel legal.

https://en.wikipedia.org/wiki/Project_Denver#History
Post reply on HN