Live data from Hacker News

Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

oblivus.com

101–110 of 135 posts

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#102
post #100

Re the pricing I see all prices given per hour (which I think is sensible), but I can't find what the granularity of usage measurement is. Assume I try something out on a GPU server and I realize I made some wrong assumption in my code and I need to think things over, so I shut down the instance after 2h 18min 24s of usage. What do I pay for? Ed. Nevermind, I found the answer here https://docs.oblivus.com/billing/pay…

Hello,

Yes, we bill our services on a minute basis, so you will only be charged for the actual usage duration, which in this case would be 139 minutes (2 hours and 19 minutes). You can find detailed information about the resources you have used and their respective costs on the Billing > Invoices page.

I hope this helps!

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#103

Hey, we produce AI tutorials on youtube - it'd be cool if we could maybe produce a video showcasing your GPU cloud?

Hello!

That sounds like an excellent suggestion. Would you mind sending an email to doruk@oblivus.com with a brief description of the video and details about your channel?

Thanks!

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#104

What is your hypervisor technology? How do you ensure isolation between tenants? PS: I see that your VMs are created in CoreWeave datacenters. I wonder the relationship between your company and CoreWeave. Are you just a reseller?

Hello,

We utilize the KVM hypervisor to ensure that all resources are dedicatedly allocated to the virtual machine.

They are among the vendors we collaborate with within the United States. To reiterate what I previously mentioned to another user, our on-demand stock comprises a diverse range of resources obtained from multiple vendors. In addition to our own infrastructure, we leverage resources from these vendors to effectively address the increasing demand for our services.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#105

Interesting name choice. I read it as "oblivious" even after looking at it a few times.

Hahaha, yeah,

Even though Oblivus doesn't have a specific meaning, we initially didn't make the connection with "oblivious". When we attended Cloudfest recently, many people also pronounced it as "oblivous," so you're not alone in that regard, I suppose. :)

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#106

Looks really cool. Congrats on the launch! A quick question. Do you allow to build custom public images? We’d love to integrate dstack.ai with Oblivus.

Thank you very much!

We are currently working on developing a feature that will allow users to create snapshots of their system disks and use those images to create multiple instances. We expect this feature to be available to everyone in a few weeks.

If you don't mind, could you please send an email to doruk@oblivus.com so that we can discuss this further?

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#107

Still pretty expensive IMO. I'm building a GPU accelerated signal processing web-app, and I'm currently planning to deploy it on a $180 Nvidia Jetson. Performances are a little bit low, but mostly enough to make the app usable. I tried to find GPU instances for Does anybody know cheaper GPU instances? I don't need much computing power, about 0.5Tflops to 1TFlops

On vast.ai I rent 3090s for $0.12 an hour. Nothing comes close in price.

Biggest problem with vast.ai is data security. It is running on somebody's PC. Anybody can get hold of your data.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#108
post #98

Curious how this compares to Tensordock? I've had great experiences with their servers + support. Vastly preferable to other first party / distributed options.

Hi there, thank you for your inquiry!

Upon review of their system, it appears that although there may be similarities, there are some notable differences between their service and ours.

Specifically, it seems that their CPU-based virtual machines come with preset configurations, lacking full customizability. Additionally, I was unable to locate an additional storage solution, reserved instances, organization and auto top-up system on their platform.

On the other hand, we do not plan on offering anything similar to their "marketplace cloud" with individual hosts.

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#109

Earlier quoted context omitted.

Thank you for sharing your thoughts. Acquiring the latest technology, such as an A100 GPU, individually from a store can indeed be quite expensive, with prices around $10,000 per unit. Additionally, setting up and maintaining a home lab to scale from one GPU to thousands can be a significant investment in terms of both cost and resources. In contrast, our platform provides access to the latest GPU technology without…

I have just bought 4 servers with 10 GPU (Titan X Pascal) and 384 GB of RAM for the price of a macbook. I found a solar powered CoLo facility to put them in. The economics of owning vs renting from AWS are worth it. My server set up is the same price as running one model on AWS.

If memory serves, NVidia's drivers can only be used for Tesla / Ampere family, if you are using them in a datacenter. Titan / GeForce are not allowed. So, there's that (but maybe I'm missing something).

Now, "running" may also mean different things. For example, you may want to do things s.a. performance diagnostics (in order to understand if your code uses resources efficiently), and then you'd need stuff like NVML, DCGM and co. Consumer-grade hardware might not be supported, or might not in principle support diagnostics collection / instrumentation. Or, if you have multiple GPU-dependent workloads that cannot saturate your resources -- you might think of MIG as being a way to address that... and, again, consumer-grade GPUs won't help you here...

I'm not saying you shouldn't try self-hosting. I'm actually all for it. But, you also need to be mindful of the pros and cons. NVidia must have some reason to pitch the datacenter family of GPUs to, well, datacenters. They aren't just blowing up prices.

Also, to give some sense of comparison:

Titan X ~= 3.5K CUDA cores.

V100 ~= 5K CUDA cores.

A100 ~= 7K CUDA cores.

H100 ~= 18.5K CUDA cores.

It probably doesn't translate directly into H100 being six times as fast as Titan X, but, I hear that these GPU workloads might be lengthy...

Re: Show HN: Oblivus GPU Cloud – Affordable and scalable GPU servers from $0.29/hr

#110

Earlier quoted context omitted.

Hello! To begin, simply create an account at https://console.oblivus.com and add a minimum of $5 to your account balance. Alternatively, you can utilize the promo code HN_1 on the same page for testing purposes. Once you deploy your server, you'll have access to a dedicated virtual machine, providing you with the capability to perform any tasks you would typically carry out on your own computer. You also have the fre…

That page is not mobile friendly FYI :-)

Thank you for bringing this to our attention.

Our team will look into this matter internally to ensure that everything is functioning properly. We appreciate your feedback!

Post reply on HN