Live data from Hacker News

Introducing Amazon EC2 P3 Instances

aws.amazon.com

31–40 of 99 posts

Re: Introducing Amazon EC2 P3 Instances

#31
post #9

The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…

I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?

showing up for me on https://aws.amazon.com/ec2/pricing/ for each of On-Demand Instances, Reserved Instances, Spot Instances, and Dedicated Hosts pricing lists. Are you selecting the regions where this is available - US East (N. Virginia), US West (Oregon), EU West (Ireland) and Asia Pacific (Tokyo)?

Re: Introducing Amazon EC2 P3 Instances

#32
post #9

The P3 instances are the first widely and easily accessible machines that use the NVIDIA Tesla V100 GPUs. These GPUs are straight up scary in terms of firepower. To give an understanding of the speed-up compared to the P2 instances for a research project of mine: + P2 (K80) with single GPU: ~95 seconds per epoch + P3 (V100) with single GPU: ~20 seconds per epoch Admittedly this isn't exactly fair for either GPU - the…

I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?

Unfortunately, P3 isn't listed yet, but this is my go to site for EC2 pricing: http://www.ec2instances.info/

Re: Introducing Amazon EC2 P3 Instances

#34
post #31

Earlier quoted context omitted.

I can't easily find pricing information on the P3 instances. Have you come across a simple table with the prices?

showing up for me on https://aws.amazon.com/ec2/pricing/ for each of On-Demand Instances, Reserved Instances, Spot Instances, and Dedicated Hosts pricing lists. Are you selecting the regions where this is available - US East (N. Virginia), US West (Oregon), EU West (Ireland) and Asia Pacific (Tokyo)?

This got me. Seems they aren't yet available in the Ohio region.

Re: Introducing Amazon EC2 P3 Instances

#36

...advanced workloads such as machine learning (ML), high performance computing (HPC), data compression, and crypto__________.

How many bitcoins can you mine out of this on max power and would it be profitable? I'm sure that Amazon has done the math on this but I'm still curious.

Re: Introducing Amazon EC2 P3 Instances

#37
post #2

Price: p3.2xlarge - $3/hr, p3.8xlarge - $12/hr, p3.16xlarge - $25/hr These look very good for half precision training

Come on, no one with any sense pays the on demand price for these things. Watch the spots.

Yep agreed. Didn't want to post the spot pricing since it changes all the time :)

Re: Introducing Amazon EC2 P3 Instances

#38
post #16

Earlier quoted context omitted.

Per the marketing material it's up to a PFLOP of mixed precision (is that the same as just saying "half precision"? or is it 8 bit?) for $25/hour. I can easily see people paying full price for that. Still, spot price is currently $2.40.

It must be a misplaced comma. 15.7 single precision can never translate to 125 mixed.

The reason Nvidia quote 120 TLFOPS mixed precision on V100 is because of the new tensor core.

https://devblogs.nvidia.com/parallelforall/inside-volta/

Re: Introducing Amazon EC2 P3 Instances

#39
post #5

An exaflop of mixed-precision compute for $250M over 3 years. That’s ballpark what the HPC community is paying for their exaflop-class machines. You’d still build your own for that money, I think, but it’s an interesting datapoint.

If you're going to be running it for 24x7 for 3 years, I think it'd be worth doing the apples-to-apples comparison of buying your own V100s vs renting them from AWS. The DGX Station with 4 V100s is $70k
Post reply on HN