Does anyone know why everyone is still buying Nvidia instead of custom AI accelerators from other vendors? For example, on paper the new Graphcore machines look like an easy win, or at least a risk worth taking. (I see this particular supercomputer was funded by Nvidia but my question is about the general trend).
The only non-NVidia device you can actually use that has broad support outside basic models in software is Google's TPUs. Graphcore looks great! But no one outside Graphcore has used them so who knows. Intel's Nervana looked great on paper, right up until they dumped it. There are some interesting accelerator options around for inference. But for training it's NVidia for almost everything, and TPUs as a good option i…
This part really confuses me. I'd love to try out their hardware, but the only cloud offering they had last time I checked made you rent a whole month's worth (for many thousands of dollars).
It seems like getting it in the hands of devs should be a top priority.