Do these TPU VMs have preemptible/spot pricing? I'm just a hobbyist, but it always seemed annoying before that one would have to orchestrate VMs to spin up/down alongside spot instances of TPUs manually.
Cloud TPU VMs are generally available
31–40 of 53 posts
Re: Cloud TPU VMs are generally available
#32Do these TPU VMs have preemptible/spot pricing? I'm just a hobbyist, but it always seemed annoying before that one would have to orchestrate VMs to spin up/down alongside spot instances of TPUs manually.
Yes, there are a couple of ways to use Cloud TPUs at lower priority and lower cost. If you are a hobbyist, I highly recommend trying out Cloud TPUs for free via the TPU Research Cloud:
https://sites.research.google/trc/
If you are flexible, you (or your scripts) can access a lot of compute power at odd hours!
Re: Cloud TPU VMs are generally available
#33I'd be more interested in the edge TPU / coral stuff for local inference, but it seems perpetually unavailable.
Re: Cloud TPU VMs are generally available
#34Earlier quoted context omitted.
Thanks for the very kind feedback! We've wanted to provide TPU VMs since the beginning of the Cloud TPU program, and I'm delighted that you're enjoying them. Many people across Google contributed to this launch. We're definitely working on GKE integration, and we intend to provide more support for orchestration over time since individual Cloud TPU workloads are getting bigger and bigger. We'd love to hear any more de…
Curious what is the difficulty with GKE integration? From afar, it seems like the flavor of VM shouldn’t impact ability to run K8s.
The GKE team probably has other priorities.
Re: Cloud TPU VMs are generally available
#35Available in new regions other than us-central?
Re: Cloud TPU VMs are generally available
#36Mostly a jest, but now you're releasing these to the public, does that mean Google's moved onto something better?
Re: Cloud TPU VMs are generally available
#37It mentions tensorflow specifically. Is there a penalty for using PyTorch instead?
Re: Cloud TPU VMs are generally available
#38For those like me who had no idea what this means: > Tensor Processing Units (TPUs) are Google's custom-developed application-specific integrated circuits (ASICs) used to accelerate machine learning workloads.
Is this[1] the best resource for understanding TPU (or TPU-like) architectures in general?
I would love to see a TPU implementation in the style of the Nand2Tetris[2] CPU, reduced to its bare essentials for learning purposes.
Are systolic array processors the best place to start for this kind of info? Thanks in advance if anyone answers. :)
[1]: https://drive.google.com/file/d/0Bx4hafXDDq2EMzRNcy1vSUxtcEk...
Re: Cloud TPU VMs are generally available
#39Do existing PyTorch models work out of the box with cloud TPU, or does it require some tweaking?
Are there cost savings over traditional GPU workloads?
When will GKE support TPU? And will there be preemptable instances?
Re: Cloud TPU VMs are generally available
#40are google cloud TPUs available in mumbai region?