Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Benchmarking TensorFlow on Nvidia GeForce RTX 3090

evolution.ai

Post reply on HN
Print view View original

31–40 of 104 posts

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#31

Post by l33tman »

wombatmobile wrote: post #14
valine wrote: post #2

Seems like a good speedup relative to the Titan, especially for the money. I’d be interested to see the performance relative to the 3080 though. There are obviously vram limitations with the 3080 but it would still be interesting to see the difference in raw compute performance. In games the 3090 only gives a 15% performance bump relative to the 3080. If that pattern holds for machine learning tasks there is probably…

If this isn't OT... Could you kindly advise what kind of computer would make sense to purchase to begin learning about ML? I was assuming I'd get a 3080. Should I get a case that could potentially house 2 x 3080's? Does the case require any special cooling considerations, or just whatever will fit the cards? What CPU would you get?

Go for it! Get a motherboard with reinforced PCIe slots for both GPUs though, the cheaper mobos only have one armoured slot. Also, you really should use the 3080 Founders Edition I guess for a dual setup as they blow out part of their heat in the back. Otherwise you need good air control and as thin 3080 cards as you can find (so there's some space between them in the case). Still waiting for good thermal benchmarks on this kind of setup...

Of course if money is an issue, you are well off with only a single 3080 :)

There is no point in buying the 20xx series anymore. The 30xx are twice as good for the same money (if you can get one).

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#32

Post by wnevets »

valine wrote: post #2

Seems like a good speedup relative to the Titan, especially for the money. I’d be interested to see the performance relative to the 3080 though. There are obviously vram limitations with the 3080 but it would still be interesting to see the difference in raw compute performance. In games the 3090 only gives a 15% performance bump relative to the 3080. If that pattern holds for machine learning tasks there is probably…

Most video games probably aren't going to make the most of all of the extra CUDA cores on the 3090. I'm assuming that helps alot with machine learning, can someone who knows for sure confirm?

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#33

Post by emteycz »

claudeganon wrote: post #30
gambiting wrote: post #28

Earlier quoted context omitted.

If you're "learning about ML" there is no point in buying anything. Just get the cloud compute instead, and for home use and testing literally anything will do. I have friends who work with ML professionally and even they say it's just hard to justify running any computations at home once you factor in the electricity and hardware cost - GCP compute just beats the cost, easily.

Agreed. If you’re just learning or building hobby stuff, you can use Colab, Paperspace, or any number of other services for free or very cheaply.

I want a gaming computer than won't limit my future ML learning. Are there any suggestions for that use case?

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#34

Post by hughes »

jakear wrote: post #3

That second table is aa good example of why always including units (or even just a "higher is better") is a good idea... I have no clue what I'm looking at. Edit: It's been edited, thx Evolution :) (or I totally glossed over it the first time around... but I don't think so)

Even after being edited, it's still wrong. It shows the significantly lower Inception4 performance as a "40% speedup" instead of 40% of baseline images/sec.

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#35

Post by TomVDB »

jakear wrote: post #3

That second table is aa good example of why always including units (or even just a "higher is better") is a good idea... I have no clue what I'm looking at. Edit: It's been edited, thx Evolution :) (or I totally glossed over it the first time around... but I don't think so)

Even after the edit, it's a bit confusing in that, without looking at the table, you get the impression that FP16 is slower than FP32.

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#36

Post by cauthon »

emteycz wrote: post #33
claudeganon wrote: post #30

Earlier quoted context omitted.

Agreed. If you’re just learning or building hobby stuff, you can use Colab, Paperspace, or any number of other services for free or very cheaply.

I want a gaming computer than won't limit my future ML learning. Are there any suggestions for that use case?

Buy whatever makes you feel happy. I agree with gambiting that anything you choose won’t limit you

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#37

Post by gambiting »

emteycz wrote: post #33
claudeganon wrote: post #30

Earlier quoted context omitted.

Agreed. If you’re just learning or building hobby stuff, you can use Colab, Paperspace, or any number of other services for free or very cheaply.

I want a gaming computer than won't limit my future ML learning. Are there any suggestions for that use case?

There's no such thing as long as you buy an actual mid to high tier GPU. Even an ancient GTX1070 would be more than enough - and for sufficiently large datasets even an RTX3090 will take hours to process whatever you're crunching.

Just buy a PC that you like for gaming(with an Nvidia gpu) and don't worry about ML yet - it's incredibly unlikely that you can pick something that would limit you in any way. Small datasets will run on anything, large datasets will take hours to process no matter what you run them on. It's not a "limit".

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#38

Post by claudeganon »

emteycz wrote: post #33
claudeganon wrote: post #30

Earlier quoted context omitted.

Agreed. If you’re just learning or building hobby stuff, you can use Colab, Paperspace, or any number of other services for free or very cheaply.

I want a gaming computer than won't limit my future ML learning. Are there any suggestions for that use case?

You're probably better off building your own machine and dual booting Windows and Linux. Here's a good guide for ML requirements, only a little out of date (published before the release of the 3080):

http://timdettmers.com/2018/12/16/deep-learning-hardware-gui...

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#39

Post by claudeganon »

gambiting wrote: post #37
emteycz wrote: post #33

Earlier quoted context omitted.

I want a gaming computer than won't limit my future ML learning. Are there any suggestions for that use case?

There's no such thing as long as you buy an actual mid to high tier GPU. Even an ancient GTX1070 would be more than enough - and for sufficiently large datasets even an RTX3090 will take hours to process whatever you're crunching. Just buy a PC that you like for gaming(with an Nvidia gpu) and don't worry about ML yet - it's incredibly unlikely that you can pick something that would limit you in any way. Small dataset…

Some off-the-shelf gaming PCs are not very Linux friendly though, so they should watch out for that, especially the laptop varieties. Getting a lot of the ML stuff working locally in Windows is a nightmare.

Re: Benchmarking TensorFlow on Nvidia GeForce RTX 3090

#40

Post by liuliu »

Seems to be good speedup overall relative to 2080 Ti (including FP16: see relatives 2080 Ti v Titan: https://lambdalabs.com/blog/2080-ti-deep-learning-benchmarks...). This suggests we should see another Titan card that is even more expensive in the pipeline given the FP16 performance? Or maybe TF32 performance is going to be what NVIDIA promotes in this generation (only if they have better number than FP16?)?
Post reply on HN