Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Linode GPU Instances

blog.linode.com

Post reply on HN
Print view View original

11–20 of 75 posts

Re: Linode GPU Instances

#11

Post by perennate »

thenightcrawler wrote: post #8

Isn't AWS cheaper? edit: could be wrong thought I read of AWS being .65 dollars an hour for deep learning GPU use. edit2: Did a quick look, the .65 dollars doesn't include the actual instance, so its around 1.8 an hour on the low end, I think this cheaper.

p2.xlarge comes with an NVIDIA Tesla K80 GPU for $0.90/hr, but this is now an "old" GPU and the RTX Quadro 6000 should have much higher performance (but I was unable to find any machine learning benchmarks).

p3.2xlarge has NVIDIA Tesla V100 GPU which is NVIDIA's most recent deep learning GPU, but it's $3.06/hr.

That said, AWS is among the most expensive providers if you just need a deep learning GPU (but obviously AWS offers a lot of other useful things). For example, OVH Public Cloud has Tesla V100 for $2.66/hr. And comparable NVIDIA GPUs that are not "datacenter-grade" should be even cheaper; AWS, GCP, Azure, etc. are unable to offer them because of contracts when they buy e.g. the Tesla V100.

Re: Linode GPU Instances

#12

Post by ilaksh »

Looks amazing. Linode has worked really well for me over the years.

One thing I noticed when recently trying to get a GPU cloud instance, the high core counts are usually locked until you put in a quota increase. Then sometimes they want to call you.

So I wonder if Linode will have to do that or if they can figure out another way to handle it that would be more convenient.

I also wonder if Linode could somehow get Windows on these? I know they generally don't do anything other than Linux though. My graphics project where I am trying to run several hundred ZX Spectrum libretro cores on one screen only runs on Windows.

Re: Linode GPU Instances

#13

Post by elabajaba »

minimaxir wrote: post #4
ksec wrote: post #3

Earlier quoted context omitted.

Are there any difference? Seems to support CUDA as well, I don't see anything wrong with it. Also seems to be a lot cheaper than AWS counterpart.

It seems like a Quadro RTX 6000 is comparable performance-wise to a P100 ( https://askgeek.io/en/gpus/vs/NVIDIA_Quadro-RTX-6000-vs-NVID... ), although there are no tests for the ML angle. A P100 on GCP is $1.46/hr alone, so maybe Linode is a good deal if the performance is indeed comparable.

RTX 6000 is significantly faster than a P100 outside of FP64, and is the fastest or 2nd fastest GPU outside of FP64 work [1] (the GV100 is sometimes faster, sometimes slower than the RTX 6000 but costs more). For FP64, GV100 based GPUS are quite a bit faster than P100s.

Also, you should really ignore pretty much all of the comparison sites that show up when you search for computer component comparisons as they're nearly all awful. The one you posted doesn't show a single benchmark comparison between them, and compares numbers like clock speed which isn't comparable between architectures, or memory clock speed instead of memory bandwidth leading to the laughable conclusion that the RTX 6000 has "9.9x more memory clock speed: 14000 MHz vs 1408 MHz" vs the P100 when the P100 uses HBM2 and has 732.2 GB/s vs 672.0 GB/s of actual memory bandwidth.

[1] https://www.reddit.com/r/hardware/comments/9xx6cz/nvidia_qua...

Re: Linode GPU Instances

#14

Post by svd4anything »

elabajaba wrote: post #13
minimaxir wrote: post #4

Earlier quoted context omitted.

It seems like a Quadro RTX 6000 is comparable performance-wise to a P100 ( https://askgeek.io/en/gpus/vs/NVIDIA_Quadro-RTX-6000-vs-NVID... ), although there are no tests for the ML angle. A P100 on GCP is $1.46/hr alone, so maybe Linode is a good deal if the performance is indeed comparable.

RTX 6000 is significantly faster than a P100 outside of FP64, and is the fastest or 2nd fastest GPU outside of FP64 work [1] (the GV100 is sometimes faster, sometimes slower than the RTX 6000 but costs more). For FP64, GV100 based GPUS are quite a bit faster than P100s. Also, you should really ignore pretty much all of the comparison sites that show up when you search for computer component comparisons as they're nea…

https://www.techpowerup.com/gpu-specs/quadro-rtx-6000.c3307

Has this section:

Theoretical Performance Pixel Rate 169.9 GPixel/s Texture Rate 509.8 GTexel/s FP16 (half) performance 32.62 TFLOPS (2:1) FP32 (float) performance 16.31 TFLOPS FP64 (double) performance 509.8 GFLOPS (1:32)

Perhaps for at least rough performance comparisons it is a good start.

My impression the current favorite card by DIY types is an RTX 2080 Ti.

https://www.techpowerup.com/gpu-specs/geforce-rtx-2080-ti.c3...

However I think nvidia will take legal action against any service provider trying to use those in a cloud or server offering.

Re: Linode GPU Instances

#15

Post by elabajaba »

MuffinFlavored wrote: post #10

Can these be used for crypto mining at any level of efficiency? I was able to mine GRLC back in the day on AWS spot instances at a VERY mild degree of profitability.

Doubtful, since these are just fully unlocked TU102 GPUs (same as the Titan RTX, 2080ti is the same TU102 GPU but partially locked at 4352 cores vs 4608 for the Quadro RTX 6000/8000 and Titan RTX). If you could be profitable with this at $1000/month then people would be flocking out to buy 2080tis for $1100 and getting 90-95% of the hashrate.

Re: Linode GPU Instances

#16

Post by walrus01 »

MuffinFlavored wrote: post #10

Can these be used for crypto mining at any level of efficiency? I was able to mine GRLC back in the day on AWS spot instances at a VERY mild degree of profitability.

not really, most cryptocurrency is at the stage where the only thing effective is a combination of custom ASICs and nearly free electricity. About twelve months ago I looked into mining ethereum with state of the art GPUs and it would not have had a reasonable ROI unless I was literally paying $0.00 per kWh. And that was before its value per coin dropped a lot.

Re: Linode GPU Instances

#18

Post by kohtatsu »

walrus01 wrote: post #16
MuffinFlavored wrote: post #10

Can these be used for crypto mining at any level of efficiency? I was able to mine GRLC back in the day on AWS spot instances at a VERY mild degree of profitability.

not really, most cryptocurrency is at the stage where the only thing effective is a combination of custom ASICs and nearly free electricity. About twelve months ago I looked into mining ethereum with state of the art GPUs and it would not have had a reasonable ROI unless I was literally paying $0.00 per kWh. And that was before its value per coin dropped a lot.

Let's replace baseboard heaters with cryptominers.

Re: Linode GPU Instances

#19

Post by picozeta »

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu

GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster.

If you then want to do even more learning the price goes even down.

//DISCLAIMER: I do not work for them, but used it for DL in the past and it was for sure cheaper than GCP or AWS. If you have to do lots of experiments (>year) go with your own hardware, but do not underestimate the convenience of >100MByte/s if you download many big training sets.

Re: Linode GPU Instances

#20

Post by zachruss92 »

perennate wrote: post #11
thenightcrawler wrote: post #8

Isn't AWS cheaper? edit: could be wrong thought I read of AWS being .65 dollars an hour for deep learning GPU use. edit2: Did a quick look, the .65 dollars doesn't include the actual instance, so its around 1.8 an hour on the low end, I think this cheaper.

p2.xlarge comes with an NVIDIA Tesla K80 GPU for $0.90/hr, but this is now an "old" GPU and the RTX Quadro 6000 should have much higher performance (but I was unable to find any machine learning benchmarks). p3.2xlarge has NVIDIA Tesla V100 GPU which is NVIDIA's most recent deep learning GPU, but it's $3.06/hr. That said, AWS is among the most expensive providers if you just need a deep learning GPU (but obviously AW…

The K80s are super outdated now. Google used to offer them for free for 12hrs a day on their Colab platform, but they upgraded them to using the Tesla T4s. Note you can get a K80 on GCP (unreserved) for $.45/hr.

This is a good deal.

Post reply on HN