Live data from Hacker News

My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

timdettmers.com

31–34 of 34 posts

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#31

Earlier quoted context omitted.

Plus the architecture improvements. Do we know how many cores per SM? They’ve decoupled int and FP execution units which could give larger increases for certain kernels (although FP heavy deep learning kernels aren’t likely to benefit as much, they will still get address calculation benefits).

I hadn't seen the whitepaper on Turing yet. Where did you see they decoupled them?

The keynote

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#32

The "I have almost no money" recommendation should include Colab. https://medium.com/deep-learning-turkey/google-colab-free-gp... Somebody who has almost no money isn't going to be able to equip a desktop with a GTX 1050 Ti ($175), fast disk ($50), and RAM ($50) on an entry level cpu/motherboard/power supply/case/monitor/peripherals ($300) and pay for the electricity used during training. Colab can be accessed from a…

What are the rules about datasets I upload to this free service? Do Google now own them?

I would imagine no more than it owns the files you upload to Google Drive. The disk on the Colab instance is ephemeral, so you will need external storage for your dataset anyway.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#33

The "I have almost no money" recommendation should include Colab. https://medium.com/deep-learning-turkey/google-colab-free-gp... Somebody who has almost no money isn't going to be able to equip a desktop with a GTX 1050 Ti ($175), fast disk ($50), and RAM ($50) on an entry level cpu/motherboard/power supply/case/monitor/peripherals ($300) and pay for the electricity used during training. Colab can be accessed from a…

If you have the programming skills necessary to develop deep learning applications, it should be assumed that you can also easily get a well-paying job so this isn't really even relevant.

Maybe you want to learn. Maybe you want to retain your current job because you like it even if it pay less then you could achieve, and you still would like to develop your other skills. Or maybe you want to stay close to your family, or in a place where they speak your mother tongue. Or maybe you just want to spend carefully your money even if you have plenty.

Re: My Experience and Advice for Using GPUs in Deep Learning: Which GPU to get

#34

The cost/performance plot - shouldn't it be "Lower is better"? It says "Higher is better". Lower value would indicate lower cost per unit level of performance. It should be "Lower is better" or the plot needs to say "Performance/Cost". Am I missing something?

Thanks for your feedback! Someone mentioned this on twitter as well and I thought it was a good point so I implemented that change.

Thanks for being receptive. I wouldn’t call it a “good point” if it was a mistake that was corrected.
Post reply on HN