Earlier quoted context omitted.
NVIDIA is the leader because most academic AI setups are NVIDIA based. When AI moves further away from academia NVIDIA will have less of a grip. Proprietary, hardware specific APIs never stand the test of time. Ask 3Dfx. Either CUDA will open up, if it is to survive or open API use will spread. Weirdly, NVIDIA hardware only outperforms competitors on its own API. When you compare NVIDIA on a level playing field, they…
> Either CUDA will open up, if it is to survive or open API use will spread. CUDA won't die if Open APIs take over AI inferencing operations. It's still used and applied in so many niche industries that it can only be "replaced" in industries like AI where companies invest in moving digital mountains. Stuff like Microsoft's ONNX project will go a long way towards making CUDA unneccesary for AI acceleration, but it wo…
Is it known, why consumer cards do not have fp64:fp32 performance at about 1:2?