Previously: https://news.ycombinator.com/item?id=43759350
AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
51–60 of 65 posts
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#52It blows my mind how reliably AMD shoots itself in the foot. What we want isn’t that hard: 1) Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. 2) Make GPU acceleration actually work out of the box for pytorch and tensorflow. Not some special fork, patched version that you “maintain” on your website,…
Adding to the list above. Please, PLEASE, give me a single place I can look to see what pytorch will actually support. I would probably buy something if I could get a straight answer on what will/won't actually work.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#53It blows my mind how reliably AMD shoots itself in the foot. What we want isn’t that hard: 1) Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. 2) Make GPU acceleration actually work out of the box for pytorch and tensorflow. Not some special fork, patched version that you “maintain” on your website,…
It doesn't diminish most of your points, but getting PyTorch to work on Arch Linux is as easy as installing the `python-pytorch-opt-rocm` package. Similar with Ollama: `ollama-rocm`. So if you just want to use PyTorch, and don't need the very latest version, I wouldn't say the dev experience with Nvidia is much better.
> Similar with Ollama: `ollama-rocm`.
Same experience here. Installing ROCm and Ollama on my box were both dead simple and everything worked right out of the box. Using an RX 7900 XTX card, FWIW.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#54Earlier quoted context omitted.
> Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. All the stuff works even if it's not officially supported. It's not that hard to set a single environment variable (HSA_OVERRIDE_GFX_VERSION). Like literally, everything works, from Vega 56/64 to ryzen 99xx iGPUs. Also, try nixos. Everything literall…
I’m using Nix and setting HSA_OVERRIDE_GFX_VERSION. It’s not working on my GPU (Radeon RX7600)
This https://www.techpowerup.com/gpu-specs/radeon-rx-7600.c4153 says that's a gfx1102. I'd expect that to work out of the box. Linux kernel version vaguely near one of the nominally supported ones?
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#55Earlier quoted context omitted.
AMD has two driver teams at this point. One of Linux/Open Source, one for Catalyst/Closed source, and they are not allowed to interact. Because, there are tons of IP and trade secrets involved in driver development and optimization. Sometimes game related, sometimes for patching a rogue application which developers can't or don't fix, etc. etc. GPU drivers are ought to be easy, but in reality, they are not. The open…
Fact of the matter is that I have a Radeon RX 6600, which I can't use with ollama. First, there is no ROCm at all in my distros repository - it doesn't compile reliably and needs too many ressources. Then, when compiling it manually, it turns out that ROCm doesn't even support the card in the first place. I'm aware that 8GB Vram are not enough for most such workloads. But no support at all? That's ridiculous. Let me…
I know it's in Debian (and thus Ubuntu), Arch, Gentoo. Pretty sure RedHat, Suse, Nix have it. What distro are you using?
ROCm is a train wreck to compile from source but can be done with sufficient bloodymindedness.
The RX6600 is a gfx1032. I used a gfx1010 for ages with this stuff. Seems likely it'll run for you if you ignore the "supported cards" list, which really should be renamed to something that antagonises people less.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#56Earlier quoted context omitted.
Fact of the matter is that I have a Radeon RX 6600, which I can't use with ollama. First, there is no ROCm at all in my distros repository - it doesn't compile reliably and needs too many ressources. Then, when compiling it manually, it turns out that ROCm doesn't even support the card in the first place. I'm aware that 8GB Vram are not enough for most such workloads. But no support at all? That's ridiculous. Let me…
I know it's in Debian (and thus Ubuntu), Arch, Gentoo. Pretty sure RedHat, Suse, Nix have it. What distro are you using? ROCm is a train wreck to compile from source but can be done with sufficient bloodymindedness. The RX6600 is a gfx1032. I used a gfx1010 for ages with this stuff. Seems likely it'll run for you if you ignore the "supported cards" list, which really should be renamed to something that antagonises pe…
I'm using void. https://github.com/void-linux/void-packages/issues/26415 gives an insight, though it doesn't explain the whole problem, if I remember correctly what maintainers wrote elsewhere.
> ROCm is a train wreck to compile from source but can be done with sufficient bloodymindedness.
Yeah, I did that myself. Not impossible, just a bit annoying and time consuming. The issue I ran into then was exactly picking the gpu model (incredible that this is even necessary) and not having the gfx1032 available, see https://github.com/void-linux/void-packages/issues/26415#iss... for what I was following back then. I tried to edit the configuration for the gfx1032 anyway, but it did not succeed.
Side note: Already having to know which card corresponds to which code is annoying, and completely unnecessary. They could also just map the consumer facing name. But that would be too easy I assume.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#57Earlier quoted context omitted.
> Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. All the stuff works even if it's not officially supported. It's not that hard to set a single environment variable (HSA_OVERRIDE_GFX_VERSION). Like literally, everything works, from Vega 56/64 to ryzen 99xx iGPUs. Also, try nixos. Everything literall…
But why do you even have to do this fucking bullshit that you randomly stumble upon, while googling error message after error message, ending up in random github repos and issues? And no, just because the three random cards you have work doesn't mean "everything works". Just tried an MI300A a few months ago... I just wanted to test ollama as this is one of the hottest applications for GPU acceleration now, it will su…
> But why do you even have to do this fucking bullshit
Because it's like 2-4 times cheaper than to go nvidia?..
> the three random cards you have
It's more than 3 random cards. I run 6900 XT, 7900 XTX, W7900 Pro, VII, VII Pro, Vega 56, Vega 64, 6800 XT, 5700 XT plus I've experimented with a 9950 iGPU, a 5xxx series iGPU and the only thing which didn't work was 3400g iGPU.
> Apparently only fp16 models work
fp8 works for me
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#58Earlier quoted context omitted.
A laundry list of excuses ... or a list of things to work on. ("Why the hell do we have two driver teams?" - would be my #1 thing to fix if I was at AMD.)
The "fix" would be to make games perform like shit on Windows and disable HDR and other proprietary features, or to abolish the open Linux drivers. You can't have both, unless you do what Nvidia does and move all of the proprietary stuff to the GPU firmware and write a minimal driver to control that massive firmware blob. Which, obviously, would require reengineering the GPU hardware, which is expensive and of questi…
AMDs open driver runs games with HDR quite well on Linux, so that specific thing is not preventing it.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#59Earlier quoted context omitted.
Sucks that you've had so much trouble... My experience with my cheap 6750XT is that it just works OOTB on Arch with rocm, llama.cpp, ollama, whisper, etc by setting an envvar.
Did you do any writeup/post on your experience with setting it up? I think it would have some audience ( apart from me that is ).
It never occurred to me because it was such an easy process kn Arch.
https://wiki.archlinux.org/title/Ollama 3 commands to install and run an LLM.
Re: AMD Publishes Open-Source Driver for GPU Virtualization, Radeon "In the Roadmap"
#60Earlier quoted context omitted.
The "fix" would be to make games perform like shit on Windows and disable HDR and other proprietary features, or to abolish the open Linux drivers. You can't have both, unless you do what Nvidia does and move all of the proprietary stuff to the GPU firmware and write a minimal driver to control that massive firmware blob. Which, obviously, would require reengineering the GPU hardware, which is expensive and of questi…
AMDs open driver runs games with HDR quite well on Linux, so that specific thing is not preventing it.
I've found it depends on the GPU. My older AMD GPU, a RX580 applies, a green tint with HDR enabled. My Radeon Vega APU's performance is terrible with HDR enabled. This is with Bazzite/CachyOS in Steam mode: HDR works fine with a newer GPU.