31–40 of 135 posts
Azure and AWS pricing for GPU’s is insane.
lambdalabs seems to be the cheapest but I haven’t used it. Anyone has experience with it?
Lots of people seem to think they have no choice but to rent GPUs from cloud service providers. Remember retail GPUs are much more powerful, much cheaper and much more available than cloud GPUs. Just go to the store and buy one.
Thank you for sharing your thoughts. Acquiring the latest technology, such as an A100 GPU, individually from a store can indeed be quite expensive, with prices around $10,000 per unit. Additionally, setting up and maintaining a home lab to scale from one GPU to thousands can be a significant investment in terms of both cost and resources. In contrast, our platform provides access to the latest GPU technology without…
So this is about 30% cheaper than GCP. But GCP sustained use discounts give you a 30% discount if used for the whole month. Azure and AWS pricing for GPU’s is insane. lambdalabs seems to be the cheapest but I haven’t used it. Anyone has experience with it?
Lots of people seem to think they have no choice but to rent GPUs from cloud service providers. Remember retail GPUs are much more powerful, much cheaper and much more available than cloud GPUs. Just go to the store and buy one.
[1] https://timdettmers.com/2023/01/16/which-gpu-for-deep-learni...
So this is about 30% cheaper than GCP. But GCP sustained use discounts give you a 30% discount if used for the whole month. Azure and AWS pricing for GPU’s is insane. lambdalabs seems to be the cheapest but I haven’t used it. Anyone has experience with it?
If you require sustained usage, we offer long-term reservations with discounts of up to 50% off our regular on-demand prices. For assistance in selecting the most suitable option for your specific needs, please feel free to email us at business@oblivus.com. We'll be happy to assist you.
So this is about 30% cheaper than GCP. But GCP sustained use discounts give you a 30% discount if used for the whole month. Azure and AWS pricing for GPU’s is insane. lambdalabs seems to be the cheapest but I haven’t used it. Anyone has experience with it?
The issue with lambda is that they're always booked out in my experience.
Earlier quoted context omitted.
In the tests I’ve done, retail GPUs are much faster than data center GPUs.
They are, but data center GPU (ampere and above) are twice as good in performance per watt.
Earlier quoted context omitted.
Would you be so kind to post these results? How much faster, which models etc.
I found some charts here showing A100 roughly doubling a 3090: https://bizon-tech.com/blog/best-gpu-for-deep-learning-rtx-3... With the 4090 being a fair amount more powerful, it might give the a100 a challenge for about 10% of the cost. That’s still about 10k hours of renting one with this service though.
[1]: https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
[2]: https://images.nvidia.com/aem-dam/Solutions/Data-Center/l4/n...
Still pretty expensive IMO. I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performances are a little bit low, but mostly enough to make the app usable. I tried to find GPU instances for Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops
Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr. https://lambdalabs.com/service/gpu-cloud
What's the availability like? I had tried it once and had problem getting any GPU.