Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

oblivus.com

Post reply on HN
Print view View original

41–50 of 135 posts

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#41

Post by oblivuslimited »

NickHoff wrote: post #39

One of the issues is availability. Lambdalabs and Paperspace never have instances available. AWS and GCP have the per-account quota set to 0 by default for GPU instances and deny requests to raise it, even to 1. (One of my AWS accounts was granted 1 GPU after some back-and-forth with support.) I'm not upset, I understand that demand is high, but how will oblivus handle availability?

Thank you for your question!

Firstly, unlike AWS, GCP, or Azure, there are no restrictions on the number of GPUs you can deploy with us. As long as you have sufficient account balance, you can deploy hundreds of GPUs simultaneously.

In terms of availability, we maintain a diverse range of resources from various vendors in our on-demand stock. While we have our own infrastructure, we also leverage infrastructure from other vendors to meet the growing demand.

Currently, we have more than 3000 GPUs in stock, with over 2600 of them available for deployment. You can find more detailed information on our availability page at https://oblivus.com/availability/.

I hope this helps!

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#42

Post by YetAnotherNick »

kbumsik wrote: post #4
wongarsu wrote: post #2

On equivalent instances it seems a good bit more expensive than e.g. lambdalabs [1], but in turn you get a lot more flexibility. Both in terms of having more GPU models to choose from, and having much more flexible machine configurations. Seems like a worthwhile tradeoff. 1: https://lambdalabs.com/service/gpu-cloud#pricing https://oblivus.com/pricing/

I am using an 8*A100 machine from Lambda Labs, but I honestly cannot understand how it can be so cheap. I haven't found a cheaper one than this. It is even cheaper than most of spot-like interruptible offerings.

Agreed. Even by their on demand price, cost per A100 per year is <$10k. Even if they somehow make maintenance and electricity cost to close to 0(which likely won't be the case), and their GPU usage 100% they are running it with operational loss for the first year.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#43

Post by NickHoff »

andrewstuart wrote: post #9

Lots of people seem to think they have no choice but to rent GPUs from cloud service providers. Remember retail GPUs are much more powerful, much cheaper and much more available than cloud GPUs. Just go to the store and buy one.

> retail GPUs are much more powerful

I agree with your basic point about building vs renting, but retail GPUs aren't simply more powerful. Retail GPUs are just as fast but have a lot less VRAM and memory bandwidth. The RTX4090 has 24 GB of VRAM with 1 TB/s of bandwidth. The A100 has 80 GB at 2 TB/s. For some tasks, the memory and bandwidth are the strongest constraints.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#44

Post by brancz »

In a world of shared GPUs, what tools do people use to profile their GPU workloads. Are there code level profilers like for CPUs? I typically hear that people don’t often have issues with the code running on the GPU itself but rather ensuring it is fed information quickly enough to stay saturated. How do people measure this and find out what to improve, especially in a shared setting?

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#45

Post by dtx1 »

oblivuslimited wrote: post #11
andrewstuart wrote: post #9

Lots of people seem to think they have no choice but to rent GPUs from cloud service providers. Remember retail GPUs are much more powerful, much cheaper and much more available than cloud GPUs. Just go to the store and buy one.

Thank you for sharing your thoughts. Acquiring the latest technology, such as an A100 GPU, individually from a store can indeed be quite expensive, with prices around $10,000 per unit. Additionally, setting up and maintaining a home lab to scale from one GPU to thousands can be a significant investment in terms of both cost and resources. In contrast, our platform provides access to the latest GPU technology without…

Eating your own dogfood I see: https://imgur.com/IXPWOSk

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#46

Post by oblivuslimited »

dtx1 wrote: post #45
oblivuslimited wrote: post #11

Earlier quoted context omitted.

Thank you for sharing your thoughts. Acquiring the latest technology, such as an A100 GPU, individually from a store can indeed be quite expensive, with prices around $10,000 per unit. Additionally, setting up and maintaining a home lab to scale from one GPU to thousands can be a significant investment in terms of both cost and resources. In contrast, our platform provides access to the latest GPU technology without…

Eating your own dogfood I see: https://imgur.com/IXPWOSk

As someone whose native language is not English, I find it helpful to use AI to grammatically correct and improve my texts. There's no shame in asking for help or using tools to improve your language skills at all.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#47

Post by dtx1 »

oblivuslimited wrote: post #46
dtx1 wrote: post #45

Earlier quoted context omitted.

Eating your own dogfood I see: https://imgur.com/IXPWOSk

As someone whose native language is not English, I find it helpful to use AI to grammatically correct and improve my texts. There's no shame in asking for help or using tools to improve your language skills at all.

Same here and don't interpret it as an accusation, more of an "huh, that's interesting", mostly cause I had the suspicion that this was partly written by ChatGPT and was able to detect it, I'm not entirely sure what made me realize it.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#48

Post by T3RMINATED »

mschuster91 wrote: post #5

> 9. No quotas or complex verification processes. Whether you represent a company, an institution, or you're a researcher, you have full access to our infrastructure without any limitations. Given how easy it is to shoot oneself in the foot with stolen credentials or bad Terraform code, I'd think it should be possible for users to set their own quota that is locked for, say, 24 hours to at least put a cap on abuse sc…

[dead]
Post reply on HN