Live data from Hacker News

Introducing Amazon EC2 P3 Instances

aws.amazon.com

41–50 of 99 posts

Re: Introducing Amazon EC2 P3 Instances

#42
post #18

Here's my results: Testing new Tesla V100 on AWS. Fine-tuning VGG on DeepSent dataset for 10 epochs. GRID 520K (4GB) (baseline): * 780s/epoch @ minibatch 8 (GPU saturated) V100(16Gb): * 30s/epoch @ minibatch 8 (GPU not saturated) * 6s/epoch @ minibatch 32 (GPU more saturated) * 6s/epoch @ minibatch 256 (GPU saturated)

Thanks! Curious how this would scale on the 8x or 16x instances

Re: Introducing Amazon EC2 P3 Instances

#47
post #9

The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…

I've been using the P100 on Softlayer and was impressed. Looks like V100 may be 2..3x faster on some tasks, will be interesting to test it.

P.S. with that memory speed, it can probably run 300..400MH/s on ETH.

Re: Introducing Amazon EC2 P3 Instances

#48
post #22

Is there an AMI that comes with Tensorflow/keras with GPU support preinstalled or you have to do it yourself?

Amazon offer an official AMI which comes preloaded with various deep learning frameworks: MXNet, TensorFlow, CNTK, Caffe/2, Theano, Torch and Keras. For the P3 (Volta V100) instances you'll want to ensure you use an AMI preloaded with CUDA 9, though not all DL frameworks are happy with that yet. https://aws.amazon.com/amazon-ai/amis/

Didn't know they had an AMI like that. Thank you.

Re: Introducing Amazon EC2 P3 Instances

#49
Slightly off-topic but I'm curious: Nvidia Volta is advertised as having "tensor cores" - what does it take for a programmer to use them? Will typical Tensorflow or Cafe code take advantage of it? Or should we wait for some new optimized version of ML frameworks?

Re: Introducing Amazon EC2 P3 Instances

#50
post #36

...advanced workloads such as machine learning (ML), high performance computing (HPC), data compression, and crypto__________.

How many bitcoins can you mine out of this on max power and would it be profitable? I'm sure that Amazon has done the math on this but I'm still curious.

It's not just that Amazon has done the math, it's that sufficiently liquid cryptocurrencies will, by the efficient market hypothesis, quickly gain enough value to make mining on whatever Amazon offers no longer profitable. As soon as you're able to profitably mine without an up-front capital investment, people will take advantage of the arbitrage opportunity until the market adjusts its price, and if the currency is designed at least somewhat competently and has enough of a working market (both of which are definitely true of Bitcoin), that won't take very long.

Cryptocurrencies are the invisible robot hand of the market. (Which is, I think, not a claim about whether they're good, but certainly a claim about whether they are to be feared. If you squint hard enough, the giant Bitcoin mines in China are the work of an unfriendly AI employing people to make paperclips.)

Post reply on HN