Live data from Hacker News

Linode GPU Instances

blog.linode.com

51–60 of 75 posts

Re: Linode GPU Instances

#52
post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

Has linode improved their security intrusion and disclosure policy yet?

These are great improvements but are virtually worthless if linode didn't change their behavior.

Re: Linode GPU Instances

#53
post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

> The difference is 8 more GB of RAM that comes at a steep premium

This is incorrect. The RTX 6000 has 24GB of VRAM and is $4000, and the RTX 8000 has 48GB of VRAM (double the amount) and is $5500. Is it worth the price increase? For a lot of people I know it is.

Also, the RTX Titan is $2500 and is identical to the RTX 6000 (at the chip level) and also with 24GB of VRAM, with the only difference being software enabling of additional H.264/5 encoding features on the Quadro. Definitely not worth the cost increase, especially for anyone doing ML.

Re: Linode GPU Instances

#54
post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

> The difference is 8 more GB of RAM that comes at a steep premium This is incorrect. The RTX 6000 has 24GB of VRAM and is $4000, and the RTX 8000 has 48GB of VRAM (double the amount) and is $5500. Is it worth the price increase? For a lot of people I know it is. Also, the RTX Titan is $2500 and is identical to the RTX 6000 (at the chip level) and also with 24GB of VRAM, with the only difference being software enabli…

If you reason as a consumer the RTX Titan makes a lot more sense than the RTX 6000, however datacenters are forbidden by Nvidia to use consumer cards [1], therefore their choice makes sense.

[1]: http://fortune.com/2018/01/07/nvidia-consumer-video-cards/

Re: Linode GPU Instances

#55

Earlier quoted context omitted.

> The difference is 8 more GB of RAM that comes at a steep premium This is incorrect. The RTX 6000 has 24GB of VRAM and is $4000, and the RTX 8000 has 48GB of VRAM (double the amount) and is $5500. Is it worth the price increase? For a lot of people I know it is. Also, the RTX Titan is $2500 and is identical to the RTX 6000 (at the chip level) and also with 24GB of VRAM, with the only difference being software enabli…

If you reason as a consumer the RTX Titan makes a lot more sense than the RTX 6000, however datacenters are forbidden by Nvidia to use consumer cards [1], therefore their choice makes sense. [1]: http://fortune.com/2018/01/07/nvidia-consumer-video-cards/

Except datacenter is not defined by NVIDIA in their EULA at all, and plenty of large and small datacenters continue to use "consumer cards" regardless of NVIDIA's fear mongering. I know that Tesla, OpenAI, Microsoft, Apple, and many others all continue to primarily buy primarily 2080Ti's, RTX Titans, and Titan V's since the EULA change.

Re: Linode GPU Instances

#56

Earlier quoted context omitted.

If you really want low cost to compute for Deep Learning and you needs lots of compute and don't want to pay for V100s, then the AMD Vega R7 is the card for you. 700 dollars, 16GB Ram, 1TB of GPU bandwidth (higher than the V100!), works with Tensorflow (pip install tensorflow-rocm), and about 60% of the performance on resnet-50.FP64 is not fully gimped (it is halved, i think - so still quite good). Two of my colleagu…

Agreed, it is not quite prime-time yet. They are trying to upstream all the ROCm stuff in TensorFlow, and when it gets into mainline and stabilizes, i agree that it has great potential for take-off - particularly from price-sensitive researchers and large companies who need huge GPU farms.

Two Questions.

I wonder if Google is in any way helping AMD in the TensorFlow and ROCm?

What happen when Intel join the GPU race in 2020. Making their own ROCm again?

Re: Linode GPU Instances

#57

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster. If you then want to do even more learning the price goes even down. //DISCLAIMER: I do not work for them, but used it for DL in the past and it was fo…

I thought you are not allowed to put Consumer Graphics Card in Datacenter?

Or is that prohibited in US only?

Re: Linode GPU Instances

#58

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster. If you then want to do even more learning the price goes even down. //DISCLAIMER: I do not work for them, but used it for DL in the past and it was fo…

Agree, had exactly the same experience. It is not a server card, however, it is much faster than any old AWS instances for 1k$/m (if you happen to be an AWS user and did not want to upgrade because of the price going up 3x) TBH, 100 bucks per month is free, while most of the researches do not have 1k$/m for a server, it is cheaper to buy hardware and put Linux on it. There are of course other options and Linode is ki…

>There are of course other options and Linode is kinda late to the party, but I am happy they made this move.

Considering their main competitor, DO, Vultr, UpCloud, none of the them offers any GPU instances, I don't think they are late at all. If not the first for their market segment.

Re: Linode GPU Instances

#59
post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

Has linode improved their security intrusion and disclosure policy yet? These are great improvements but are virtually worthless if linode didn't change their behavior.

What incident are you referring to? (genuine question)

As far as standards go, we use Linode and all of our customers (some of them quite demanding about internal security details) have been satisfied with the various acronyms they are accredited with... Although I understand this does not necessarily guarantee anything about response behavior, so interested to hear about past incidents.

Re: Linode GPU Instances

#60
post #59

Earlier quoted context omitted.

Has linode improved their security intrusion and disclosure policy yet? These are great improvements but are virtually worthless if linode didn't change their behavior.

What incident are you referring to? (genuine question) As far as standards go, we use Linode and all of our customers (some of them quite demanding about internal security details) have been satisfied with the various acronyms they are accredited with... Although I understand this does not necessarily guarantee anything about response behavior, so interested to hear about past incidents.

There were some compromised accounts via a Coldfusion hack of their admin portal.

Not sure if that was isolated.

There was something more recent, too.

Anyway, happy Linode customer for quite a few years now. My stuff works, no fuss.

Post reply on HN