Earlier quoted context omitted.
The new CEO of Intel has said that Intel is giving up competing with Nvidia. No, he said they're giving up competing against Nvidia in training. Instead, he said Intel will focus on inference. That's the correct call in my opinion. Training is far more complex and will span multi data centers soon. Intel is too far behind. Inference is much simpler and likely a bigger market going forward.
I disagree - training enormous LLMs is super complex and requires a data centre... But most research is not done at that scale. If you want researchers to use your hardware at scale you also have to make it so they can spend a few grand and do small scale research with one GPU on their desktop. That's how you get things like good software support in AI frameworks.
Inference is vastly simpler than training or scientific compute.