Live data from Hacker News

My low cost provider of GPUs has run out of capacity. Good alternatives?

hetzner.com

41–50 of 92 posts

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#42

Earlier quoted context omitted.

~ 8.5x higher price than Hetzner.

Yes, they're at a much higher price point, but it's also way cheaper than AWS. I certainly understand the draw of Hetzner's price point!

> Yes, they're at a much higher price point, but it's also way cheaper than AWS.

Everything is way cheaper than AWS.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#44
post #43
post #31

I think Ebay and TaoBao are now filled to the brim with discarded mining GPUs

how much life do these typically have left in them?

Limited by caps and electromigration. I'd say a half life of 10-15 years

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#45
Vast AI (https://vast.ai) are good, 1x GTX 1080 comes to about $170/month. You are charged by the hour unlike Hetzner.

There are obviously downsides to renting time from random individuals though, so it's not suitable for a server-like workload. Good for development notebooks or training.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#46
post #36

Earlier quoted context omitted.

Yes, they're at a much higher price point, but it's also way cheaper than AWS. I certainly understand the draw of Hetzner's price point!

How is Herzner able to be so much cheaper than the competition?

They have addons for most support issues, including priority incidents - throughout the years we've been with them, it can take ~2-5 hours before someone even reply to complete server downtime.

We mostly host proxmox nodes and use HA, so it's not much of an issue when it's used like this.

OVH is very similar, although, Hetzner is often quicker.

We only use server-grade (Like Xeon or EPYC), not the desktop ones (No ECC memory).

If one need many IP's, OVH always wins in price due to it being a one-time cost, while Hetzner charges monthly.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#47
post #32

Colocation with ebay'd servers and graphics cards. Some people don't know there's somewhere in between building a datacentre and cloud servers.

That's not a low cost solution though, and hard to just turn off the cost when you're done with your day

> hard to just turn off the cost when you're done with your day

Yeah, but the same is true of OP's Hetzner machines.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#48

Vast AI ( https://vast.ai ) are good, 1x GTX 1080 comes to about $170/month. You are charged by the hour unlike Hetzner. There are obviously downsides to renting time from random individuals though, so it's not suitable for a server-like workload. Good for development notebooks or training.

I recently used Vast.ai for ~3 weeks to run an anime BigGAN ( https://www.gwern.net/Faces#biggan ) and the stability/uptime was pretty much 100%: it never went down or caused problems. (I had problems, but they were all due to the BigGAN.) As long as a little downtime isn't too big a deal or you can script changing instances (they have a CLI tool), you probably could run as a server.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#49
post #44
post #43

Earlier quoted context omitted.

how much life do these typically have left in them?

Limited by caps and electromigration. I'd say a half life of 10-15 years

My concern would be the fans dying. Consumer-grade cards have quiet fans which have 1/4 the life of a loud ball-bearing fan.

Re: My low cost provider of GPUs has run out of capacity. Good alternatives?

#50
post #26

Hetzner has provided a quality service for a long time but now they have no more GPU servers available. That makes it hard to scale. Any other options out there without going bankrupt on AWS?

scaleway has GPUs now: https://www.scaleway.com/en/gpu-instances/

500€ instead of 111€ though
Post reply on HN