Linode GPU Instances • Hacker News Board

Re: Linode GPU Instances

#31

Post by krick » Thu, Jun 20, 2019, 2:58 AM UTC

picozeta wrote: post #19

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster. If you then want to do even more learning the price goes even down. //DISCLAIMER: I do not work for them, but used it for DL in the past and it was fo…

It's a flat fee of $100/month, correct? What would be the best option if the amount of training you do is rather "occasional" (but simply using colab doesn't cut it anymore)?

Re: Linode GPU Instances

#32

Post by tootahe45 » Thu, Jun 20, 2019, 3:22 AM UTC

krick wrote: post #31

picozeta wrote: post #19

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster. If you then want to do even more learning the price goes even down. //DISCLAIMER: I do not work for them, but used it for DL in the past and it was fo…

It's a flat fee of $100/month, correct? What would be the best option if the amount of training you do is rather "occasional" (but simply using colab doesn't cut it anymore)?

I don't have specific experience with ML, but AWS spot pricing is by far the best deal last time i checked for GPU. You can get something much more powerful than a gtx1080 and get your task done more quickly. The downside is that at any time your instance can be shut down after a short warning signal to backup your progress, so it may or may not be suitable for what you're doing.

Re: Linode GPU Instances

#33

Post by noir_lord » Thu, Jun 20, 2019, 3:23 AM UTC

azinman2 wrote: post #17

coherentpony wrote: post #9

Does anybody know if there are any cloud instances with AMD GPUs?

What would you want it for over nvidia in the cloud?

Testing if nothing else, I'd you are shipping to be people running AMD GPUs then that would be useful without having to buy a card and another machine for it to go in

Re: Linode GPU Instances

#34

Post by Who_me » Thu, Jun 20, 2019, 3:29 AM UTC

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can.

One of the biggest questions is why the Quadro RTX 6000? Few things:

1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point.

2. We have all heard or used the Tesla V100, and it's a great card. The biggest issue is that it's expensive. So one of the things that caught our eye is the RTX 6000 has a fast Single-Precision Performance, Tensor Performance, and INT8 performance. Plus the Quadro RTX supports INT4. https://www.nvidia.com/content/dam/en-zz/Solutions/design-vi... https://images.nvidia.com/content/technologies/volta/pdf/tes... Yes, these are manufactures numbers, but it caused us pause. As always, your mileage may vary.

3. RT cores. This is the first time (TMK) that a cloud provider is bringing RT cores into the market. There are many use cases for RT that have yet to be explored. What will we come up with as a community?!

Now with all that being said, there is a downside, FP64 aka double precision. The Tesla V100 does this very well, whereas the Quadro RTX 6000 does poorly in comparison. We think although those workloads are important, the goal was to find a solution that fits a vast majority of the use cases.

So is the marketing true to get the most out of MI/AI/Etc? Do you need a Tesla to get the best performance? Or is the Tesla starting to show its age? Give the cards a try I think you'll find these new RTX Quadros with Turning architecture are not the same as the Quadros of the past.

Re: Linode GPU Instances

#35

Post by tootahe45 » Thu, Jun 20, 2019, 3:30 AM UTC

MuffinFlavored wrote: post #10

Can these be used for crypto mining at any level of efficiency? I was able to mine GRLC back in the day on AWS spot instances at a VERY mild degree of profitability.

They wouldn't be available if they were profitable for that. Providers usually make you do extra verification to use these instances because people were at a time using them for that, not because it was profitable, but because they used stolen cloud accounts/cards.

Re: Linode GPU Instances

#36

Post by tntn » Thu, Jun 20, 2019, 4:08 AM UTC

Who_me wrote: post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

> This is the first time (TMK) that a cloud provider is bringing RT cores into the market.

Your knowledge is incomplete. T4 has been available in google cloud for many months.

Re: Linode GPU Instances

#37

Post by hmart » Thu, Jun 20, 2019, 4:32 AM UTC

I love Linode support. There are cheaper places but I have my Key VPSs there.

Re: Linode GPU Instances

#38

Post by Who_me » Thu, Jun 20, 2019, 4:33 AM UTC

tntn wrote: post #36

Who_me wrote: post #34

Hey peeps full disclosure I work as one of Linode's RnD engineers. I want to try to get to as many of these as I can. One of the biggest questions is why the Quadro RTX 6000? Few things: 1. Cost it has the same performance as the 8000. The difference is 8 more GB of RAM that comes at a steep premium. Cost is important to us as it allows us to be at a more affordable price point. 2. We have all heard or used the Tesla…

> This is the first time (TMK) that a cloud provider is bringing RT cores into the market. Your knowledge is incomplete. T4 has been available in google cloud for many months.

I stand corrected thank you!

Re: Linode GPU Instances

#39

Post by listic » Thu, Jun 20, 2019, 5:07 AM UTC

picozeta wrote: post #19

I would go with Hetzner: https://www.hetzner.com/dedicated-rootserver/ex51-ssd-gpu GTX1080 for 100$ a month. Grantend, it is older, but it still works for DL. Let's say you do 10 experiments a month for ~20 hours. Thats 0.5$/hour and I don't think it is 3 times faster. If you then want to do even more learning the price goes even down. //DISCLAIMER: I do not work for them, but used it for DL in the past and it was fo…

vast.ai is even cheaper https://vast.ai/console/create/

Re: Linode GPU Instances

#40

Post by krick » Thu, Jun 20, 2019, 5:11 AM UTC

tootahe45 wrote: post #32

krick wrote: post #31

Earlier quoted context omitted.

It's a flat fee of $100/month, correct? What would be the best option if the amount of training you do is rather "occasional" (but simply using colab doesn't cut it anymore)?

I don't have specific experience with ML, but AWS spot pricing is by far the best deal last time i checked for GPU. You can get something much more powerful than a gtx1080 and get your task done more quickly. The downside is that at any time your instance can be shut down after a short warning signal to backup your progress, so it may or may not be suitable for what you're doing.

Does the price actually depend on whether you are using a GPU or simply an instance you choose? Let's say you need to do some work that will require a GPU, so you spend 5 hours setting up an environment, doing some light programming/experiments in an Jupyter notebook, downloading datasets, looking at the data. Then you train for an hour then one more hour looking at the data, drinking coffee, stuff like that. Then train again.

So you were using the environment for 10 hour, but only 3 of them in total were using GPU. Will you pay for 10 hours of GPU usage, or will only 3h be expensive and 7h cheap?