Amazon Orders More than 10,000 Nvidia Tesla cards • Hacker News Board

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#11

Post by tisme » Fri, Oct 05, 2012, 6:02 AM UTC

dave_sullivan wrote: post #5

mercuryrising wrote: post #3

Amazon's cloud might be one of the coolest things I've seen in a while, hop on, get some of the best computing performance possible, get off and save some money. If you have a random data analysis problem that would take your computer three weeks, why not just pay $10 and get it done in two hours (plus a few hours of debugging)? If the article is correct, Amazon paid 15 million for those cards which will be out of st…

I've looked hard at using amazons gpu clusters, and the math just doesn't work out. If you're working on applications that will need to be using the gpu regularly, you can build a system with 4 gtx580s for about $3,000, and one of those systems will outperform 2, maybe 3, aws gpu instances, which will run you about 1000 per month each. The ownership number does not include data center/power/etc., but I still think bu…

Why would you buy the previous generation GPUs when you can get the current one?

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#12

Post by pavanky » Fri, Oct 05, 2012, 6:03 AM UTC

samg_ wrote: post #7

dave_sullivan wrote: post #5

Earlier quoted context omitted.

I've looked hard at using amazons gpu clusters, and the math just doesn't work out. If you're working on applications that will need to be using the gpu regularly, you can build a system with 4 gtx580s for about $3,000, and one of those systems will outperform 2, maybe 3, aws gpu instances, which will run you about 1000 per month each. The ownership number does not include data center/power/etc., but I still think bu…

Yeah, I did a few trial runs on the cluster gpu instances maybe 4 months ago. I found that, while the gpus themselves were really quite fast, moving data in and out of gpu was not. Maybe amazon will focus on increasing bandwidth to the gpu for the new boxes.

To be fair, there should not be a lot of data transfers to and from the GPU. Moving larger chunks of data (instead of many smaller ones) when you are running out of memory, using asynchronous data / compute streams would increase the performance.

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#13

Post by pavanky » Fri, Oct 05, 2012, 6:10 AM UTC

tisme wrote: post #11

dave_sullivan wrote: post #5

Earlier quoted context omitted.

I've looked hard at using amazons gpu clusters, and the math just doesn't work out. If you're working on applications that will need to be using the gpu regularly, you can build a system with 4 gtx580s for about $3,000, and one of those systems will outperform 2, maybe 3, aws gpu instances, which will run you about 1000 per month each. The ownership number does not include data center/power/etc., but I still think bu…

Why would you buy the previous generation GPUs when you can get the current one?

Because the current series (GTX 680) is severely stunted for CUDA compared to the GTX 580. The single precision performance of 680 barely beats the 580. The double precision performance on the GTX series sucks in general, but NVIDIA actually made it twice as worse going from 580 to 680. (Benchmarks linked at bottom).

The reasoning may have been to focus the GTX series more on gaming. Or it could be more sinister to push more people towards their costlier Tesla Line. Considering that they came out with the K10 which has terrible double precision performance, but incredible single precision performance, I think they are heading towards multiple Tesla lines and want to push the GTX series away from the serious GPGPU computing.

Disclaimer: The following is my company's blog. The post is authored by me. http://blog.accelereyes.com/blog/2012/04/26/benchmarking-kep...

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#14

Post by pavanky » Fri, Oct 05, 2012, 6:27 AM UTC

dave_sullivan wrote: post #5

mercuryrising wrote: post #3

Amazon's cloud might be one of the coolest things I've seen in a while, hop on, get some of the best computing performance possible, get off and save some money. If you have a random data analysis problem that would take your computer three weeks, why not just pay $10 and get it done in two hours (plus a few hours of debugging)? If the article is correct, Amazon paid 15 million for those cards which will be out of st…

I've looked hard at using amazons gpu clusters, and the math just doesn't work out. If you're working on applications that will need to be using the gpu regularly, you can build a system with 4 gtx580s for about $3,000, and one of those systems will outperform 2, maybe 3, aws gpu instances, which will run you about 1000 per month each. The ownership number does not include data center/power/etc., but I still think bu…

6Gigs on a single GPU is very tempting. And the single precision performance (Theoretically 2.2 TFLOPS) per GPU on the K10 is more than anything else you can get on the market. To buy one of those would cost you $3500-$4000. To buy two + motherboard + xeon would probably cost you close to $10,00. If you want to scale it and set up a cluster, the cost per machine scales up and the amount of man hours spent would become a factor.

Amazon offers a heavy usage deal which comes out to ~ $11,000 per instance if used 24x7x365.

You could argue that the cluster / machine you set up would be useful for more than a year. This is true to an extent, but at the current rate of development GPUs become obsolete rather quickly and suddenly having a cluster on the cloud sounds more appealing than going through the process of updating your machines every 18-20 months.

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#15

Post by Nick_C » Fri, Oct 05, 2012, 10:25 AM UTC

srunni wrote: post #8

mercuryrising wrote: post #3

Amazon's cloud might be one of the coolest things I've seen in a while, hop on, get some of the best computing performance possible, get off and save some money. If you have a random data analysis problem that would take your computer three weeks, why not just pay $10 and get it done in two hours (plus a few hours of debugging)? If the article is correct, Amazon paid 15 million for those cards which will be out of st…

> If you have a random data analysis problem that would take your computer three weeks, why not just pay $10 and get it done in two hours (plus a few hours of debugging)? I'm facing this very problem myself right now with some GPU-bound calculations. The issue for me is that the software I'm using isn't free, so I'm stuck running it on the one machine that I do have a license for it to run on. It's a very frustrating…

I wonder if this might be a game changer for software like Matlab, SAS, et al. A licence would buy you the right to one install locally and one on a cloud server. (Although last time I had anything to do with Matlab licensing and user negotiation, they move at a pace common to that of glaciers. With the same temperature.)

Re: Amazon Orders More than 10,000 Nvidia Tesla cards

#16

Post by tisme » Fri, Oct 05, 2012, 4:09 PM UTC

pavanky wrote: post #13

tisme wrote: post #11

Earlier quoted context omitted.

Why would you buy the previous generation GPUs when you can get the current one?

Because the current series (GTX 680) is severely stunted for CUDA compared to the GTX 580. The single precision performance of 680 barely beats the 580. The double precision performance on the GTX series sucks in general, but NVIDIA actually made it twice as worse going from 580 to 680. (Benchmarks linked at bottom). The reasoning may have been to focus the GTX series more on gaming. Or it could be more sinister to p…

Thank you very much for that reply.

I have a 590 and I'm pretty happy with it, been eying the 690 but I wasn't able to find any real world non gaming benchmarks.