61–70 of 92 posts
Hetzner has provided a quality service for a long time but now they have no more GPU servers available. That makes it hard to scale. Any other options out there without going bankrupt on AWS?
Colocation with ebay'd servers and graphics cards. Some people don't know there's somewhere in between building a datacentre and cloud servers.
That's not a low cost solution though, and hard to just turn off the cost when you're done with your day
Elsewhere in the thread, it sounds like your needs a little more robust. But for anyone reading who might be interested: - Tesla K40 12GB cards are ~$130 on US eBay, and have been for awhile - These cards are passive, though, intending to be used in wind tunnel servers - However, you can put on 40mm screamer fans to cool them in a normal desktop. Something like https://www.thingiverse.com/thing:3032044 or just wire-t…
Aws and Google spot instances are easily comparable price wise to hetzner but it really depends on what you are doing, which you haven't said. For example a g3 spot instance can be as low as 19 cents per hour $138/month. Google GPU instances I've run for 14 cents an hour. I think these aren't the lowest prices either.
Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7.
It runs on the order of 50x faster on an nvidia GPU compared to a CPU.
But it will sit idle most of the time.
Price per hour per GB of GPU ram is the most important metric when choosing a server.
Golem has GPUs for very cheap on its network so ask here https://www.reddit.com/r/GolemProject/ or https://twitter.com/golemproject?lang=en . Golem website is www.golem.network
I don't see prices listed. Something seems wrong.
This company does something pretty similar minus the blockchain and is much more straightforward: https://www.zerosix.ai/ , same with https://vast.ai/console/create/
Elsewhere in the thread, it sounds like your needs a little more robust. But for anyone reading who might be interested: - Tesla K40 12GB cards are ~$130 on US eBay, and have been for awhile - These cards are passive, though, intending to be used in wind tunnel servers - However, you can put on 40mm screamer fans to cool them in a normal desktop. Something like https://www.thingiverse.com/thing:3032044 or just wire-t…
K80 are for ~$400, 24GB, 2xGPU, newer architecture, a bit better choice.
I wonder how are they dealing with nvidia EULAs about using geforce series cards in datacenters. Maybe that is the issue?
Courts in Germany have ruled that you can not add additional clauses to a contract after the contract has been signed, e.g. the purchase has been made. So unless Hetzner is buying directly from nvidia, nvidia has no way to enforce such a clause. And when I buy a nvidia card at any retailer in Germany, I will not have to sign a contract that obligates me to not use it in a data center - heck I can just take the box of…
Aws and Google spot instances are easily comparable price wise to hetzner but it really depends on what you are doing, which you haven't said. For example a g3 spot instance can be as low as 19 cents per hour $138/month. Google GPU instances I've run for 14 cents an hour. I think these aren't the lowest prices either.
The main use case is on demand neural net inference 24/7 availability. Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7. It runs on the order of 50x faster on an nvidia GPU compared to a CPU. But it will sit idle most of the time. Price per hour per GB of GPU ram is the most important metric when choosing a server.
Wasn't it forbidden by the driver licence to use 1080 on cloud ? Nvidia tries to bully you to buy ultra expensive Tesla card for that. Maybe the germans don't care ?
Are there other examples of this sort of restriction that actually make sense. I can think of warnings ('don't use this keychain carabineer for climbing') but not actual use restrictions that are sensible?
Aws and Google spot instances are easily comparable price wise to hetzner but it really depends on what you are doing, which you haven't said. For example a g3 spot instance can be as low as 19 cents per hour $138/month. Google GPU instances I've run for 14 cents an hour. I think these aren't the lowest prices either.
The main use case is on demand neural net inference 24/7 availability. Kind of like hosting a website that must be on 24/7, this neural net must be on 24/7. It runs on the order of 50x faster on an nvidia GPU compared to a CPU. But it will sit idle most of the time. Price per hour per GB of GPU ram is the most important metric when choosing a server.