AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
1–10 of 17 posts
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#2I really hope AMD gains more ground on the software side.
I know they are "technically supported" by onyx/pytorch etc. But almost every project I've seen there's a bunch of asterisks, a bunch of people needing different work arounds, and subpar performance compared to the hardware.
Maybe it's because most people have their consumer cards? Nvidia however doesn't have this issue, people on pascal are only just now having compatibility issues with not supporting a high enough cuda version.
The dream is they release a 4090-type competitor for a few grand, it doesn't even need full 4090-level performance, just strap 48gb+ of HBM and it would be a absolutely incredible deal for individuals learning/researching -> who then use the full enterprise stuff for full training/commercial inference.
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#3According to this and SemiAnalysis[1], the MI300X seems impressive. Better than Nvidia's H100 and maybe a bit inferior to the H200. Why is Nvidia worth $1 trillion more?
[1] - https://www.semianalysis.com/p/amd-mi300-performance-faster-...
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#4I really hope AMD gains more ground on the software side. I know they are "technically supported" by onyx/pytorch etc. But almost every project I've seen there's a bunch of asterisks, a bunch of people needing different work arounds, and subpar performance compared to the hardware. Maybe it's because most people have their consumer cards? Nvidia however doesn't have this issue, people on pascal are only just now havi…
Their software is definitely improving and will get a whole lot better in the next few years. It's worth many billions for companies to exit the Nvidia lock-in.
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#5According to this and SemiAnalysis[1], the MI300X seems impressive. Better than Nvidia's H100 and maybe a bit inferior to the H200. Why is Nvidia worth $1 trillion more? [1] - https://www.semianalysis.com/p/amd-mi300-performance-faster-...
CUDA
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#6I really hope AMD gains more ground on the software side. I know they are "technically supported" by onyx/pytorch etc. But almost every project I've seen there's a bunch of asterisks, a bunch of people needing different work arounds, and subpar performance compared to the hardware. Maybe it's because most people have their consumer cards? Nvidia however doesn't have this issue, people on pascal are only just now havi…
Their software is definitely improving and will get a whole lot better in the next few years. It's worth many billions for companies to exit the Nvidia lock-in.
As long, as it doesn't support normal consumer hardware, AMD won't get the support Nvidia GPUs enjoy from community projects.
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#7According to this and SemiAnalysis[1], the MI300X seems impressive. Better than Nvidia's H100 and maybe a bit inferior to the H200. Why is Nvidia worth $1 trillion more? [1] - https://www.semianalysis.com/p/amd-mi300-performance-faster-...
$9B in profit vs $300M will have that effect.
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#8According to this and SemiAnalysis[1], the MI300X seems impressive. Better than Nvidia's H100 and maybe a bit inferior to the H200. Why is Nvidia worth $1 trillion more? [1] - https://www.semianalysis.com/p/amd-mi300-performance-faster-...
$9B in profit vs $300M will have that effect.
Sure but the future is not the past
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#9According to this and SemiAnalysis[1], the MI300X seems impressive. Better than Nvidia's H100 and maybe a bit inferior to the H200. Why is Nvidia worth $1 trillion more? [1] - https://www.semianalysis.com/p/amd-mi300-performance-faster-...
CUDA
CUDA is becoming less important over time
Re: AMD Launches Instinct MI300X AI Accelerator, Up to 60% Faster Than Nvidia H100
#10I really hope AMD gains more ground on the software side. I know they are "technically supported" by onyx/pytorch etc. But almost every project I've seen there's a bunch of asterisks, a bunch of people needing different work arounds, and subpar performance compared to the hardware. Maybe it's because most people have their consumer cards? Nvidia however doesn't have this issue, people on pascal are only just now havi…
I suspect that those who would otherwise be buying thousands of H100s would simply put in the dev work to make the software function well on AMD hardware