Thunder from the Cloud: 40k Cores Running in Concert on AWS
1–9 of 9 posts
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#2This is pretty awesome. Does anyone know if google or azure can scale to 40,000 cores on demand like that?
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#3Would love to see another post where this is run on Google and Azure as well and the results are compared.
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#4This is pretty awesome. Does anyone know if google or azure can scale to 40,000 cores on demand like that?
I work at DL (although not technical team) and can attest that this is attainable for GCP, and we do so on a fairly regular basis. I cannot speak to Azure, but I expect it too is likely.
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#5This is pretty awesome. Does anyone know if google or azure can scale to 40,000 cores on demand like that?
I'm building a 160,000 core cluster on GCP right now. It took a week to get the quota increase approved, but GCP can definitely handle it.
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#6what's the cost on something like this?
Re: Thunder from the Cloud: 40k Cores Running in Concert on AWS
#7what's the cost on something like this?
It cost less than $5000 to run on AWS. More if you include engineering's time.