Is there an AMI that comes with Tensorflow/keras with GPU support preinstalled or you have to do it yourself?
Introducing Amazon EC2 P3 Instances
21–30 of 99 posts
Re: Introducing Amazon EC2 P3 Instances
#22Is there an AMI that comes with Tensorflow/keras with GPU support preinstalled or you have to do it yourself?
Amazon offer an official AMI which comes preloaded with various deep learning frameworks: MXNet, TensorFlow, CNTK, Caffe/2, Theano, Torch and Keras.
For the P3 (Volta V100) instances you'll want to ensure you use an AMI preloaded with CUDA 9, though not all DL frameworks are happy with that yet.
Re: Introducing Amazon EC2 P3 Instances
#23Why Ireland and not the UK? I can imagine a lot of startups/banks in London could use this... Brexit fears?
London region is tiny and not the region to go to unless you have specific geolocation requirements.
Re: Introducing Amazon EC2 P3 Instances
#24More details in my blog post at https://aws.amazon.com/blogs/aws/new-amazon-ec2-instances-wi...
Re: Introducing Amazon EC2 P3 Instances
#25Why Ireland and not the UK? I can imagine a lot of startups/banks in London could use this... Brexit fears?
Because Ireland is so close to the UK that the latency will not matter?
Re: Introducing Amazon EC2 P3 Instances
#26...advanced workloads such as machine learning (ML), high performance computing (HPC), data compression, and crypto__________.
Re: Introducing Amazon EC2 P3 Instances
#27Why Ireland and not the UK? I can imagine a lot of startups/banks in London could use this... Brexit fears?
The London Region is really new. Amazon are using it as a way in to UK-only projects (specifically healthcare due to NHS regulations). I suspect their datacentres are considerably smaller than that of Ireland along with their client-base for the moment.
I wouldn't read too much in to it, brexit-wise.
Re: Introducing Amazon EC2 P3 Instances
#28The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…
I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?
Re: Introducing Amazon EC2 P3 Instances
#29Earlier quoted context omitted.
There are enough companies out there with deep pockets that want to do some ML. They'll pay pay those prices, no questions asked.
Per the marketing material it's up to a PFLOP of mixed precision (is that the same as just saying "half precision"? or is it 8 bit?) for $25/hour. I can easily see people paying full price for that. Still, spot price is currently $2.40.
It must be a misplaced comma. 15.7 single precision can never translate to 125 mixed.
Re: Introducing Amazon EC2 P3 Instances
#30The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…
I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?
On-demand prices from amazons pricing page https://aws.amazon.com/ec2/pricing/on-demand/ (select Virginia region):
p3.2xlarge: 8 vCPU, 61 GB RAM, $3.06/h
p3.8xlarge: 32 vCPU, 244 GB, $12.24/h
p3.16xlarge: 64v CPU, 488 GB., $24.48/h