Why isn't AMD's MI300X competitive?

#1

Post by colonCapitalDee » Tue, Apr 28, 2026, 1:11 AM UTC

Why isn't AMD's MI300X competitive?
newsletter.semianalysis.com

Re: Why isn't AMD's MI300X competitive?

#2

Post by pstuart » Tue, Apr 28, 2026, 1:54 AM UTC

If AMD's betting the company on their AI compute, they had best follow the advice in the article because the only way to compete with NVIDIA is to meet/exceed not just the performance but also the DevX.

Re: Why isn't AMD's MI300X competitive?

#3

Post by _aavaa_ » Tue, Apr 28, 2026, 2:36 AM UTC

[2024]

Re: Why isn't AMD's MI300X competitive?

#4

Post by DiabloD3 » Tue, Apr 28, 2026, 4:09 AM UTC

I love how they just butcher that article.

I remember when it came out a little over a year ago, and its just as wrong as it is today as it was then.

Re: Why isn't AMD's MI300X competitive?

#5

Post by Havoc » Thu, Apr 30, 2026, 10:17 AM UTC

Mirrors the geohotz rants about AMD at the time, though as others point out this - 2024 - is ancient news in AI world and not quite sure what value it adds to the current discussions

Re: Why isn't AMD's MI300X competitive?

#6

Post by [deleted] » Thu, Apr 30, 2026, 10:20 AM UTC

[deleted]

Re: Why isn't AMD's MI300X competitive?

#7

Post by andy_ppp » Thu, Apr 30, 2026, 10:23 AM UTC

Please just get everything in PyTorch to work, and work well (and across all graphics cards too). This is the starting point and it doesn't matter how you do it. But the fact you cannot even do some very basic stuff on AMD is going to mean you are left unused by researchers, so getting further up the stack is going to be almost impossible.

Re: Why isn't AMD's MI300X competitive?

#8

Post by ZiiS » Thu, Apr 30, 2026, 10:28 AM UTC

Correction: Why wasn't it competitive 2 years ago; basically half the AI summer ago.

Re: Why isn't AMD's MI300X competitive?

#9

Post by joelthelion » Thu, Apr 30, 2026, 10:39 AM UTC

andy_ppp wrote: post #7

Please just get everything in PyTorch to work, and work well (and across all graphics cards too). This is the starting point and it doesn't matter how you do it. But the fact you cannot even do some very basic stuff on AMD is going to mean you are left unused by researchers, so getting further up the stack is going to be almost impossible.

The problem is "just". "Just" getting pytorch to work and to work well is a huge undertaking.

Re: Why isn't AMD's MI300X competitive?

#10

Post by tripledry » Thu, Apr 30, 2026, 10:40 AM UTC

Havoc wrote: post #5

Mirrors the geohotz rants about AMD at the time, though as others point out this - 2024 - is ancient news in AI world and not quite sure what value it adds to the current discussions

Has this changed, If I want to go hands on with development using pytorch or whatever is used now, would you recommend an AMD card?

Genuine question, I have not followed this topic closely for years :)