Earlier quoted context omitted.
AMD is not too far behind. They can go wild in a few years.
In the LLM world, each month is a year and each week is a month. AMD hasn't done anything substantive in the past two years since GPT-3/GPT-3.5. Almost every research paper implements their algorithm in CUDA. AMD can't beat software with good hardware.
Nvidia is in the limelight, but their product (GPU compute) is a commodity.
Once someone else has it cheaper, then it’s a race to the bottom.