Earlier quoted context omitted.
To Nvidia the biggest threat is a capex cut from big tech not another company in the same domain, maybe some Chinese companies but people aren't going to be moving off of Nvidia for large deployments in the short term even if some TPU/Tranium etc is used it's not close to Nvidia. I have no explanation other than people, researchers are comfortable with it and don't want to switch.
Nvidia's software support remains "best in class" so they've become the default for a lot of this stuff. To overcome that I think you'd have to get a lot of hobbyists and by extension interested young people using your hardware instead of Nvidia. So you'd have to have good software support, decent hardware, and low hardware cost. People started with Nvidia because most machines had an Nvidia card in them, and Nvidia'…
My best GPU is 5070Ti on which the best model I can run is Laguna S 2.1 118B with NVFP4 and offloading most experts on CPU with an expert router layer and 128k context.
I could kill for a 1000$ AMD or Intel card with 32 or 48GB of VRAM even GDDR6 around a 1000$ range but it feels like no one even cares.
With ~4 48GB cards I could seriously locally deploy most open models models with some SSD offloading and good 4bit quantizations with ok context sizes. But at current prices.. sigh... I tried begging Intel to maybe it's cards available in my region but alas no such luck especially not at reasonable prices.
Honestly getting an AI subscription feels cheap atm and working hard at solving and home labing stuff is insane.
Even in research no one cares about anything but Nvidia, because at this point they are expensive but they seem to care, I just don't see others caring though I have worked with Intel gpu and compute teams on implementing this stuff and they are very enthusiastic but well the companies themselves aren't solving anything for me as an individual, but they are begging for me to add support for their stack in software I maintain. The Irony is unreal, why should I even add support when no one can even use it.
Only company that had decent stuff was surprisingly Apple but their stuff is now too expensive as well. .sigh.