what is the differentiation from RunPod? (they have pretty much same prices but with more services..)
Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
51–60 of 135 posts
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#52One of the issues is availability. Lambdalabs and Paperspace never have instances available. AWS and GCP have the per-account quota set to 0 by default for GPU instances and deny requests to raise it, even to 1. (One of my AWS accounts was granted 1 GPU after some back-and-forth with support.) I'm not upset, I understand that demand is high, but how will oblivus handle availability?
Thank you for your question! Firstly, unlike AWS, GCP, or Azure, there are no restrictions on the number of GPUs you can deploy with us. As long as you have sufficient account balance, you can deploy hundreds of GPUs simultaneously. In terms of availability, we maintain a diverse range of resources from various vendors in our on-demand stock. While we have our own infrastructure, we also leverage infrastructure from…
> you can deploy hundreds of GPUs simultaneously.
> with over 2600 of them available for deployment.
guessing you mean 2600 in total.
FWIW we ran a workload recently on AWS that required a few thousand g4 instances in a single AWS region. We ended up scavenging and using g3s as well due to capacity constraints.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#53Earlier quoted context omitted.
They are, but data center GPU (ampere and above) are twice as good in performance per watt.
Aside from being green and that, why would a consumer care about a leased processor's performance per watt?
Given a relative amount of benefit, with a ratio of Watts/Benefit, a lower ratio of Watts/Benefit should cost less to the consumer.
So the consumer would care because the service is lower cost.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#54Earlier quoted context omitted.
Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr. https://lambdalabs.com/service/gpu-cloud
Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.
what do you mean with "the estimated cost of approximately $800 per month"?
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#55Earlier quoted context omitted.
Lambda Cloud has A100 40GB for $1.10/hr—less than half the price of OP). We also just launched H100s for $2.40/hr. https://lambdalabs.com/service/gpu-cloud
> We also just launched H100s for $2.40/hr. What's the availability like? I had tried it once and had problem getting any GPU.
We have lots of H100s available right now.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#56Earlier quoted context omitted.
They are, but data center GPU (ampere and above) are twice as good in performance per watt.
Aside from being green and that, why would a consumer care about a leased processor's performance per watt?
The retail price of renting the GPU includes, among other things, the cost of the power bill that the cloud service pays (or else they'd lose money.) The more efficient GPU will, all else the same, be cheaper to lease.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#57Earlier quoted context omitted.
Thank you for your question! Firstly, unlike AWS, GCP, or Azure, there are no restrictions on the number of GPUs you can deploy with us. As long as you have sufficient account balance, you can deploy hundreds of GPUs simultaneously. In terms of availability, we maintain a diverse range of resources from various vendors in our on-demand stock. While we have our own infrastructure, we also leverage infrastructure from…
> you can deploy hundreds of GPUs simultaneously. > with over 2600 of them available for deployment. guessing you mean 2600 in total. FWIW we ran a workload recently on AWS that required a few thousand g4 instances in a single AWS region. We ended up scavenging and using g3s as well due to capacity constraints.
That's quite an impressive workload!
If you're using our on-demand service and intend to terminate the machines once your work is completed, we currently have 2600 available GPUs. However, if you have an ongoing need for these machines, we also have reserved instances with additional stock, which brings our total capacity to an estimated 7000 GPUs as of today.
But of course these numbers could easily change in the future.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#58Lots of people seem to think they have no choice but to rent GPUs from cloud service providers. Remember retail GPUs are much more powerful, much cheaper and much more available than cloud GPUs. Just go to the store and buy one.
> retail GPUs are much more powerful I agree with your basic point about building vs renting, but retail GPUs aren't simply more powerful. Retail GPUs are just as fast but have a lot less VRAM and memory bandwidth. The RTX4090 has 24 GB of VRAM with 1 TB/s of bandwidth. The A100 has 80 GB at 2 TB/s. For some tasks, the memory and bandwidth are the strongest constraints.
AI being a primary example, and that's probably the thing most people are renting these for nowadays anyways.
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#59Earlier quoted context omitted.
Aside from being green and that, why would a consumer care about a leased processor's performance per watt?
Given a relative amount of benefit, with a ratio of Watts/Benefit, a lower ratio of Watts/Benefit should cost less to the consumer. So the consumer would care because the service is lower cost.
[deleted]
Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr
#60Earlier quoted context omitted.
Engaging in self-promotion without taking the time to understand the context is not helpful. Moreover, the estimated cost of approximately $800 per month would still apply, which may not be within the desired budget.
what do you mean with "the estimated cost of approximately $800 per month"?
Parent is saying $1.10/hr = $792/mo of GPU leasing. GGP is looking for $50/mo. Obviously $792 is a lot higher than the GGP's request for $50/mo.
Whether or not $50/mo is an unreasonable ask (it is), they have a budget and feel that even $85/mo is too far out of budget for their application.