Random question: Why are we still using mostly GPUs for computation rather than CPUs custom-designed for ML tasks?
Why not?
Introducing Amazon EC2 P3 Instances
91–99 of 99 posts
Re: Introducing Amazon EC2 P3 Instances
#92The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…
Nice comment. In regard to your reference to reducing precision to FP16 for performance gains, you might want to read a recently published paper by Baidu Research and NVIDIA teams on mixed precision training of deep learning models (link to the paper is at the end of the following relevant post): https://www.nextplatform.com/2017/10/11/baidu-sheds-precisio.... Enjoy! :-)
Re: Introducing Amazon EC2 P3 Instances
#93The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…
Oops, just saw that you referenced the same paper in a comment below. Sorry! :-)
Re: Introducing Amazon EC2 P3 Instances
#94More details in my blog post at https://aws.amazon.com/blogs/aws/new-amazon-ec2-instances-wi...
This post states, "In order to take full advantage of the NVIDIA Tesla V100 GPUs and the Tensor cores, you will need to use CUDA 9 and cuDNN7." What version of TensorFlow does it use? From what I can tell, TensorFlow doesn't fully support the latest versions yet.
Chris from NV here. You can also get a full compliment of DL framework containers, as well as CUDA 9/CuDNN 7/NCCL 2 base container, optimized for Volta by NVIDIA via this AMI
https://aws.amazon.com/marketplace/pp/B076K31M1S?qid=1509089...
Re: Introducing Amazon EC2 P3 Instances
#95Is there an AMI that comes with Tensorflow/keras with GPU support preinstalled or you have to do it yourself?
Amazon offer an official AMI which comes preloaded with various deep learning frameworks: MXNet, TensorFlow, CNTK, Caffe/2, Theano, Torch and Keras. For the P3 (Volta V100) instances you'll want to ensure you use an AMI preloaded with CUDA 9, though not all DL frameworks are happy with that yet. https://aws.amazon.com/amazon-ai/amis/
Be careful with the non-CUDA 9 AMIs.
CUDA 8 programs will run, but terribly slowly as they JIT their GPU code without optimization for Volta. You want the CUDA 9 AMI version (https://aws.amazon.com/marketplace/pp/B076TGJHY1?qid=1509090...), but it currently only has MXNet and TF.
If you need other frameworks there's the NVIDIA AMI (https://aws.amazon.com/marketplace/pp/B076K31M1S?qid=1509090...) and Volta optimized containers for NVCaffe, Caffe2, CNTK, Digits, MXNet, PyTorch, TensorFlow, Theano, Torch, CUDA 9/CuDNN7/NCCL.
Re: Introducing Amazon EC2 P3 Instances
#96Re: Introducing Amazon EC2 P3 Instances
#97Re: Introducing Amazon EC2 P3 Instances
#98Earlier quoted context omitted.
This post states, "In order to take full advantage of the NVIDIA Tesla V100 GPUs and the Tensor cores, you will need to use CUDA 9 and cuDNN7." What version of TensorFlow does it use? From what I can tell, TensorFlow doesn't fully support the latest versions yet.
Chris from NV here. You can also get a full compliment of DL framework containers, as well as CUDA 9/CuDNN 7/NCCL 2 base container, optimized for Volta by NVIDIA via this AMI https://aws.amazon.com/marketplace/pp/B076K31M1S?qid=1509089...
Are there any frameworks yet supporting the advertised 120 TFLOPs mixed precision training?
Re: Introducing Amazon EC2 P3 Instances
#99Hi guys, Dillon here from Paperspace ( https://www.paperspace.com ). We are a cloud that specializes in GPU infrastructure and software. We launched V100 instances a few days ago in our NY and CA regions and its much less expensive than AWS. Think of us as the DigitalOcean for GPUs with a simple, transparent pricing and effortless setup & configuration: AWS: $3.06/hr V100* Paperspace: $2.30 /hr or $980/month for dedi…
do you have spot instance pricing as well?