TPUs vs. GPUs and why Google is positioned to win AI race in the long term
1–10 of 328 posts
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#2A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#3Any chance of a bit of support for jax-metal, or incorporating apple silicon support into Jax?
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#4Right because people would love to get locked into another even more expensive platform.
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#5A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
the entire organisation has been built over the last 25 years to produce GPUs
turning a giant lumbering ship around is not easy
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#6A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
> what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
Nothing prevents them per se, but it would risk cannibalising their highly profitable (IIRC 50% margin) higher end cards.
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#7A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
the entire organisation has been built over the last 25 years to produce GPUs turning a giant lumbering ship around is not easy
For sure, I did not mean to imply they could do it quickly or easily, but I have to assume that internally at Nvidia there's already work happening to figure out "can we make chips that are better for AI and cheaper/easier to make than GPUs?"
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#8[deleted]
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#9A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
Nothing in principle.
But Huang probably doesn't believe in hyper specializing their chips at this stage because it's unlikely that the compute demands of 2035 are something we can predict today.
For a counterpoint, Jim Keller took Tenstorrent in the opposite direction. Their chips are also very efficient, but even more general purpose than NVIDIA chips.
Re: TPUs vs. GPUs and why Google is positioned to win AI race in the long term
#10A question I don't see addressed in all these articles: what prevents Nvidia from doing the same thing and iterating on their more general-purpose GPU towards a more focused TPU-like chip as well, if that turns out to be what the market really wants.
That's exactly what Nvidia is doing with tensor cores.