41–50 of 65 posts
Anyone else find it funny that AMD releases new GPU features while people still can't get basic ML stuff working? It's like building a fancy garage before fixing the broken car.
And they open sourced their GPU driver, which is a massive plus in my book.
If Radeon got virtualization support, it would make it the perfect GPU for running video games (or other GPU applications) in virtual machines - you wouldn't need to mess with PCIe passthrough anymore.
This article is almost unreadable for me. The ads change in size and make the text jump. I'm adding it to NotebookLM now.
Earlier quoted context omitted.
AMD has two driver teams at this point. One of Linux/Open Source, one for Catalyst/Closed source, and they are not allowed to interact. Because, there are tons of IP and trade secrets involved in driver development and optimization. Sometimes game related, sometimes for patching a rogue application which developers can't or don't fix, etc. etc. GPU drivers are ought to be easy, but in reality, they are not. The open…
Fact of the matter is that I have a Radeon RX 6600, which I can't use with ollama. First, there is no ROCm at all in my distros repository - it doesn't compile reliably and needs too many ressources. Then, when compiling it manually, it turns out that ROCm doesn't even support the card in the first place. I'm aware that 8GB Vram are not enough for most such workloads. But no support at all? That's ridiculous. Let me…
Try it out! Benchmarks here: https://github.com/ggml-org/llama.cpp/discussions/10879
(ollama doesn’t support vulkan for some weird reason. I guess they never pulled the code from llama.cpp)
Earlier quoted context omitted.
I guess that you don't understand that how silicon and 3rd party IP works. It took Intel a completely new GPU from scratch to be able to open drivers. AMD did at least one revision to their silicon to enable that kind of openness. Yet, HDMI forum said that they can't implement an HDMI2.1 capable driver in the open, with some nasty legal letters. I have a couple of friends who wrote 3D engines from scratch and debugge…
But who holds these patents? And what are they about?
It blows my mind how reliably AMD shoots itself in the foot. What we want isn’t that hard: 1) Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. 2) Make GPU acceleration actually work out of the box for pytorch and tensorflow. Not some special fork, patched version that you “maintain” on your website,…
Earlier quoted context omitted.
Fact of the matter is that I have a Radeon RX 6600, which I can't use with ollama. First, there is no ROCm at all in my distros repository - it doesn't compile reliably and needs too many ressources. Then, when compiling it manually, it turns out that ROCm doesn't even support the card in the first place. I'm aware that 8GB Vram are not enough for most such workloads. But no support at all? That's ridiculous. Let me…
My recent experience has been that the Vulkan support in llama.cpp is pretty good. It may lag behind Cuda / Metal for the bleeding edge models if they need a new operator. Try it out! Benchmarks here: https://github.com/ggml-org/llama.cpp/discussions/10879 (ollama doesn’t support vulkan for some weird reason. I guess they never pulled the code from llama.cpp)
related: (AMD 2.0 – New Sense of Urgency) https://news.ycombinator.com/item?id=43780972
It blows my mind how reliably AMD shoots itself in the foot. What we want isn’t that hard: 1) Support your graphics cards on linux using kernel drivers that you upstream. All of them. Not just a handful - all the ones you sell from say 18 months ago till today. 2) Make GPU acceleration actually work out of the box for pytorch and tensorflow. Not some special fork, patched version that you “maintain” on your website,…
AMD has never understood that software is important. It's not culturally baked into them.
What I wrote about this on twitter: https://x.com/HotAisle/status/1914549886185611627