Random question: Why are we still using mostly GPUs for computation rather than CPUs custom-designed for ML tasks?
Can you expand on that?
Introducing Amazon EC2 P3 Instances
71–80 of 99 posts
Re: Introducing Amazon EC2 P3 Instances
#72Hi guys, Dillon here from Paperspace ( https://www.paperspace.com ). We are a cloud that specializes in GPU infrastructure and software. We launched V100 instances a few days ago in our NY and CA regions and its much less expensive than AWS. Think of us as the DigitalOcean for GPUs with a simple, transparent pricing and effortless setup & configuration: AWS: $3.06/hr V100* Paperspace: $2.30 /hr or $980/month for dedi…
I've really enjoyed using your service, especially the cloud desktops. I use them for running Fusion 360 (windows only) from my ubuntu xps when I'm away from home.
Both the interface and GPU prices are fantastic.
Keep up the good work!
Re: Introducing Amazon EC2 P3 Instances
#73Random question: Why are we still using mostly GPUs for computation rather than CPUs custom-designed for ML tasks?
GPUs are quite good at doing arithmetic in parallel. A large part of machine learning is doing arithmetic on large data sets. It makes sense to do these operations in parallel. For example, implementing k-nearest neighbors on a GPU is almost 2 orders of magnitude faster than on a CPU[0].
GPUs just work very well when you have a a lot of data and you are able to run the operations on the data set in parallel. Machine learning seems to fit this model quite well which is why you see many GPUs used in this field. Other things that take advantage of parallelism would be graphics and crypto-currency mining.
[0] http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159...
Re: Introducing Amazon EC2 P3 Instances
#74Hi guys, Dillon here from Paperspace ( https://www.paperspace.com ). We are a cloud that specializes in GPU infrastructure and software. We launched V100 instances a few days ago in our NY and CA regions and its much less expensive than AWS. Think of us as the DigitalOcean for GPUs with a simple, transparent pricing and effortless setup & configuration: AWS: $3.06/hr V100* Paperspace: $2.30 /hr or $980/month for dedi…
One of the biggest challenges with deep learning is training data. AWS makes loading large datasets easy with S3. What does Paperspace have to help with this? If I have to perform deep learning on multi-TB datasets in S3, any compute cost benefits get cancelled out by the increased data transfer cost from S3.
Re: Introducing Amazon EC2 P3 Instances
#75More details in my blog post at https://aws.amazon.com/blogs/aws/new-amazon-ec2-instances-wi...
This post states, "In order to take full advantage of the NVIDIA Tesla V100 GPUs and the Tensor cores, you will need to use CUDA 9 and cuDNN7." What version of TensorFlow does it use? From what I can tell, TensorFlow doesn't fully support the latest versions yet.
Re: Introducing Amazon EC2 P3 Instances
#76More details in my blog post at https://aws.amazon.com/blogs/aws/new-amazon-ec2-instances-wi...
This post states, "In order to take full advantage of the NVIDIA Tesla V100 GPUs and the Tensor cores, you will need to use CUDA 9 and cuDNN7." What version of TensorFlow does it use? From what I can tell, TensorFlow doesn't fully support the latest versions yet.
TF 1.4 does, but you need to build it yourself. RC1 is out:
https://github.com/tensorflow/tensorflow/releases/tag/v1.4.0...
All our prebuilt binaries have been built with CUDA 8 and cuDNN 6.
We anticipate releasing TensorFlow 1.5 with CUDA 9 and cuDNN 7.Re: Introducing Amazon EC2 P3 Instances
#77Earlier quoted context omitted.
I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?
Unfortunately, P3 isn't listed yet, but this is my go to site for EC2 pricing: http://www.ec2instances.info/
Oh, it is now listed. Be sure to click on "Columns" and add "GPU" to see the different options
Re: Introducing Amazon EC2 P3 Instances
#78Earlier quoted context omitted.
Come on, no one with any sense pays the on demand price for these things. Watch the spots.
There are enough companies out there with deep pockets that want to do some ML. They'll pay pay those prices, no questions asked.
Also all startups with (basically) unlimited aws credits
Re: Introducing Amazon EC2 P3 Instances
#79Hi guys, Dillon here from Paperspace ( https://www.paperspace.com ). We are a cloud that specializes in GPU infrastructure and software. We launched V100 instances a few days ago in our NY and CA regions and its much less expensive than AWS. Think of us as the DigitalOcean for GPUs with a simple, transparent pricing and effortless setup & configuration: AWS: $3.06/hr V100* Paperspace: $2.30 /hr or $980/month for dedi…
Your pricing page notably omits transfer pricing. Do you have free bandwidth between yourself and AWS/GCP/Azure or do you peer at any major exchanges? Getting the data into and out of compute services is the most difficult part financially, at least in my experience.
Dan here (also Paperspace team). Totally agree that transfer costs are a significant pain point which is why we do not charge for it. We can peer with other providers (eg with AWS we can leverage Direct Connect directly from our datacenters) but most of our customers don't implement this unless they're moving major traffic.
Re: Introducing Amazon EC2 P3 Instances
#80But where are the C5 instances? It's been 11 months since Amazon announced Skylake C5's and we're still waiting! https://aws.amazon.com/about-aws/whats-new/2016/11/coming-so...
Waiting for them as well. Most of all, we really need fast-CPU instances with the ENA, not the Intel NIC.
Out of professional curiosity, what are you looking for from ENA?
(I'm an engineer on Google Compute Engine with a deep interest in customer networking use stories, particularly heavy utilization customers, even if they're not my customers :)