Live data from Hacker News

My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

timdettmers.com

1–10 of 34 posts

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#2
This is a great article and I highly respect his opinions.

However, since you are probably eagerly reading this to see how fast the new RTX cards are, so you should know upfront that the numbers he has so far are just estimates based on specs:

> Note that the numbers for the RTX 2080 and RTX 2080 Ti should be taken with a grain of salt since no hard performance numbers existed. I estimated performance according to a roofline model of matrix multiplication and convolution under this hardware together with Tensor Core benchmarks from the V100 and Titan V.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#3
post #2

This is a great article and I highly respect his opinions. However, since you are probably eagerly reading this to see how fast the new RTX cards are, so you should know upfront that the numbers he has so far are just estimates based on specs: > Note that the numbers for the RTX 2080 and RTX 2080 Ti should be taken with a grain of salt since no hard performance numbers existed. I estimated performance according to a…

A great way to turn a listing you can trust enough to use as one of your comparison basis, into a listing made up of imaginary marketing numbers.

I guess the click baiting is needed / the best option, but I hate that's it's what most web resources are like now.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#4
post #3
post #2

This is a great article and I highly respect his opinions. However, since you are probably eagerly reading this to see how fast the new RTX cards are, so you should know upfront that the numbers he has so far are just estimates based on specs: > Note that the numbers for the RTX 2080 and RTX 2080 Ti should be taken with a grain of salt since no hard performance numbers existed. I estimated performance according to a…

A great way to turn a listing you can trust enough to use as one of your comparison basis, into a listing made up of imaginary marketing numbers. I guess the click baiting is needed / the best option, but I hate that's it's what most web resources are like now.

But the article isn't hiding the fact that the numbers are estimates. People are curious how the new cards will stack up, and this article provides the best evaluation of that given the information they have available.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#6
post #3
post #2

This is a great article and I highly respect his opinions. However, since you are probably eagerly reading this to see how fast the new RTX cards are, so you should know upfront that the numbers he has so far are just estimates based on specs: > Note that the numbers for the RTX 2080 and RTX 2080 Ti should be taken with a grain of salt since no hard performance numbers existed. I estimated performance according to a…

A great way to turn a listing you can trust enough to use as one of your comparison basis, into a listing made up of imaginary marketing numbers. I guess the click baiting is needed / the best option, but I hate that's it's what most web resources are like now.

No one minds comparing some products as guesses/estimates/extrapolations with some products as being real performance figures. So long as it's clear which products have which type of figure.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#7
The cost/performance plot - shouldn't it be "Lower is better"? It says "Higher is better".

Lower value would indicate lower cost per unit level of performance.

It should be "Lower is better" or the plot needs to say "Performance/Cost". Am I missing something?

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#8
Hacker news hug of death? Anyone here have any experience using AMD cards with something like PlaidML? I have a 1050Ti SSC but I'm starting to feel the limitation as my complexity grows. But getting a 1080 is a bit out of my budget right now. I'm tempted to get the new Vega 56 released recently.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#9

The cost/performance plot - shouldn't it be "Lower is better"? It says "Higher is better". Lower value would indicate lower cost per unit level of performance. It should be "Lower is better" or the plot needs to say "Performance/Cost". Am I missing something?

You're missing the principle of charity.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#10
post #2

This is a great article and I highly respect his opinions. However, since you are probably eagerly reading this to see how fast the new RTX cards are, so you should know upfront that the numbers he has so far are just estimates based on specs: > Note that the numbers for the RTX 2080 and RTX 2080 Ti should be taken with a grain of salt since no hard performance numbers existed. I estimated performance according to a…

I'd guess that the performance could be slightly better than the 1080 scaled by cores/MHz/FLOPS. The reason being that the memory bandwidth is higher on the 2080, and that's hard to model unless the person knows exactly how efficient the kernel is and if it's memory bound.
Post reply on HN