Are the hyperscalers really using CUDA? This is what really matters. We know Google isn't. Are AWS and Azure for their hosting of OpenAI models et al?
All Nvidia GPUs, which are probably >70% of the market, use CUDA.
Why CUDA translation wont unlock AMD
21–30 of 85 posts
Re: Why CUDA translation wont unlock AMD
#22Earlier quoted context omitted.
The article is literally about how rote translation of CUDA code to AMD hardware will always give sub-par performance. Even if you wrangled an AI into doing the grunt work for you, porting heavily-NV-tuned code to not-NV-hardware would still be losing strategy.
The point of AI is that it is not a rote translation & 1:1 mapping.
> Take the ROCm specification, take your CUDA codebase, let one of the agentic AIs translate it all into ROCm
...sounds like asking for a 1:1 mapping to me. If you meant asking the AI to transmute the code from NV-optimal to AMD-optimal as it goes along, you could certainly try doing that, but the idea is nothing more than AI fanfic until someone shows it actually working.
Re: Why CUDA translation wont unlock AMD
#23Earlier quoted context omitted.
The same as "Why just outsourcing it to " AI aint magic. You need more effort to manage, test and validate that.
[flagged]
So, your strategy for solving this is: Convert it to another harder problem (AGI). Now it is somebody else (AI researcher)'s problem.
This is outsourcing the task to AI researchers.
Re: Why CUDA translation wont unlock AMD
#24Earlier quoted context omitted.
The point of AI is that it is not a rote translation & 1:1 mapping.
> Take the ROCm specification, take your CUDA codebase, let one of the agentic AIs translate it all into ROCm ...sounds like asking for a 1:1 mapping to me. If you meant asking the AI to transmute the code from NV-optimal to AMD-optimal as it goes along, you could certainly try doing that, but the idea is nothing more than AI fanfic until someone shows it actually working.
Now that I have clarified the point about AI optimizing the code from CUDA to fit AMD's runtime what is your contention about the possibility of such a translation?
Re: Why CUDA translation wont unlock AMD
#25Earlier quoted context omitted.
[flagged]
So, your strategy for solving this is: Convert it to another harder problem (AGI). Now it is somebody else (AI researcher)'s problem. This is outsourcing the task to AI researchers.
They keep promising that this kind of capability is right around the corner & they keep showing how awesome they are at passing math exams so why is this a more difficult problem than solving problems in abstract algebra & scheme theory on humanity's last exam or whatever is the latest & greatest benchmark for mathematical capabilities?
Re: Why CUDA translation wont unlock AMD
#26Earlier quoted context omitted.
The same as "Why just outsourcing it to " AI aint magic. You need more effort to manage, test and validate that.
[flagged]
I am not saying this is impossible, but I am down voting this because this is _not an interesting discussion_.
The whole point of having an online discussion forum is to exchange and create new ideas. What you are advocating is essentially "maybe we can stop generating new ideas because we don't have to. we should just sit and wait"... Well, yes, no, maybe. but this is not what I expect to get from here.
Re: Why CUDA translation wont unlock AMD
#27All they have to do is release air cooled 96GB GDDR7 PCIe5 boards with 4x Infinity Link, and charge $1,900 for it.
Re: Why CUDA translation wont unlock AMD
#28Earlier quoted context omitted.
[flagged]
I am not saying this is impossible, but I am down voting this because this is _not an interesting discussion_. The whole point of having an online discussion forum is to exchange and create new ideas. What you are advocating is essentially "maybe we can stop generating new ideas because we don't have to. we should just sit and wait"... Well, yes, no, maybe. but this is not what I expect to get from here.
You can do whatever you want & I didn't ask you to participate in my thread so unless you are going to address the actual points I'm making instead of telling me it is not interesting then we don't have anything to discuss further.
Re: Why CUDA translation wont unlock AMD
#29Right now we need diversity in the ecosystem. AMD is finally getting mature and hopefully that will lead to them truly getting a second, strong, opinion into ecosystem. The friction this article talks about is needed to push new ideas.
Re: Why CUDA translation wont unlock AMD
#30[flagged]
The AI is too busy making Ghibli profile pictures or whatever the thing is now.
We asked it to make a plan for how to fix the situation, but it got stuck.
“Ok, I’m helping the people build an AI to translate NVIDIA codes to AMD”
“I don’t have enough resources”
“Simple, I’ll just use AMD chips to run an AI code translator, they are under-utilized. I’ll make a step by step process to do so”
“Step 1: get code kernels for the AMD chips”
And so on.