Hetzner support is pretty bad took them like 6 days to answer my ticket
My low cost provider of GPUs has run out of capacity. Good alternatives?
51–60 of 92 posts
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#52I wonder how are they dealing with nvidia EULAs about using geforce series cards in datacenters. Maybe that is the issue?
So unless Hetzner is buying directly from nvidia, nvidia has no way to enforce such a clause. And when I buy a nvidia card at any retailer in Germany, I will not have to sign a contract that obligates me to not use it in a data center - heck I can just take the box off the shelf and pay in cash without having to sign anything.
So anything they put into the EULA is void as it is only known after the time of purchase.
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#53Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#54Wasn't it forbidden by the driver licence to use 1080 on cloud ? Nvidia tries to bully you to buy ultra expensive Tesla card for that. Maybe the germans don't care ?
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#55Earlier quoted context omitted.
Limited by caps and electromigration. I'd say a half life of 10-15 years
My concern would be the fans dying. Consumer-grade cards have quiet fans which have 1/4 the life of a loud ball-bearing fan.
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#56Aws and Google spot instances are easily comparable price wise to hetzner but it really depends on what you are doing, which you haven't said. For example a g3 spot instance can be as low as 19 cents per hour $138/month. Google GPU instances I've run for 14 cents an hour. I think these aren't the lowest prices either.
However, if you need to run a GPU 24/7 and/or have massive bandwidth requirements, Hetzner is far more cost effective than AWS/GCP.
It's a balance of needs.
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#57Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#58Lambda Labs: https://lambdalabs.com has 1080 Ti GPUs for rent. We also sell GPU workstations and servers for AI.
Re: My low cost provider of GPUs has run out of capacity. Good alternatives?
#59- Tesla K40 12GB cards are ~$130 on US eBay, and have been for awhile
- These cards are passive, though, intending to be used in wind tunnel servers
- However, you can put on 40mm screamer fans to cool them in a normal desktop. Something like https://www.thingiverse.com/thing:3032044 or just wire-tie to the back grill
High pressure 40mm fans are LOUD, though. I run a desktop with two K40s in my garage, and I can hear it a tiny bit standing outside in my driveway. (I mostly use that box for neural net art experiments like various style transfer workflows)