It's a good price at ~0.30$/hour comparing to Paperspace's RTX 4000 with 30GB RAM at ~0.56$/hour.
Are there many other providers for such environments?
Hetzner GPU Server
41–50 of 164 posts
Re: Hetzner GPU Server
#42The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
Hetzner is not only able to get better volume discounts, they also spend a lot of engineering time bringing down costs, and have decades of experience doing so.
They offer some Dell Servers for those that really want them, but most of their servers have a custom mix of consumer hardware, server hardware and in-house hardware (for example they use their own racking system), optimized to minimize lifetime cost in a datacenter. For example most servers use datacenter SSDs, but consumer CPUs.
Re: Hetzner GPU Server
#43The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
If you pay European (German) energy prices, this very well may be the case, in my experience. For some Hetzner servers (especially from their "Server Auctions"), for domestic customers the cost of electricity alone, disregarding the hardware cost, would sometimes be higher than the rent Hetzner wants.
[deleted]
Re: Hetzner GPU Server
#44The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
It's definitely weird that cloud costs which is supposed to be commoditized is differing by 2 orders of magnitude. Hetzner/OVH seemed to have solved the hard part of making the service cheaper but just can't solve the easier task of making the platform usable. Why do I need to upload documents for verification. Why can't I try server for 2 hours right after signing up for the service.
Re: Hetzner GPU Server
#45The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
It's definitely weird that cloud costs which is supposed to be commoditized is differing by 2 orders of magnitude. Hetzner/OVH seemed to have solved the hard part of making the service cheaper but just can't solve the easier task of making the platform usable. Why do I need to upload documents for verification. Why can't I try server for 2 hours right after signing up for the service.
Those are part of making it cheaper. ID verification is an anti-fraud measure and ensures that bans stick, which in turn means they don't have to invest so heavily in heuristic anti-fraud and "spam filtering" type work. A delay on provisioning means they are provisioning hardware JIT in some cases, meaning they need less idle float capacity, which in turn drives down costs.
Re: Hetzner GPU Server
#46The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
It's definitely weird that cloud costs which is supposed to be commoditized is differing by 2 orders of magnitude. Hetzner/OVH seemed to have solved the hard part of making the service cheaper but just can't solve the easier task of making the platform usable. Why do I need to upload documents for verification. Why can't I try server for 2 hours right after signing up for the service.
Have been in deep contact with data centre and rental server offerings in the past, there is a crazy large amount of fraud going on, e.g. 2 hours for free means 2 hours free resource to DDOS.
Re: Hetzner GPU Server
#47Earlier quoted context omitted.
NVIDIA's licensing. Note that the 3060/3070 is a "GeForce" whereas a 4000 is a "Quadro". Then look at the GeForce driver EULA: https://www.nvidia.com/content/DriverDownloads/licence.php?l... > No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted. I could never figure out why they allowed blockchain processing, given how wastef…
Because they made a lot of money selling to miners at prices that maybe they couldn't ask to gamers?
Wouldn't the GeForce license then say "no block chain" and a different NVIDIA brand (BlockForce?) would allow it, letting NVDA charge more for large scale mining? Otherwise it looks like gamers and miners are paying the same prices.
Re: Hetzner GPU Server
#48Earlier quoted context omitted.
NVIDIA's licensing. Note that the 3060/3070 is a "GeForce" whereas a 4000 is a "Quadro". Then look at the GeForce driver EULA: https://www.nvidia.com/content/DriverDownloads/licence.php?l... > No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted. I could never figure out why they allowed blockchain processing, given how wastef…
Because they made a lot of money selling to miners at prices that maybe they couldn't ask to gamers?
I bet that now the AI demand spike will be the new crypto demand spike that NVDA latches onto.
Re: Hetzner GPU Server
#49The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
It's definitely weird that cloud costs which is supposed to be commoditized is differing by 2 orders of magnitude. Hetzner/OVH seemed to have solved the hard part of making the service cheaper but just can't solve the easier task of making the platform usable. Why do I need to upload documents for verification. Why can't I try server for 2 hours right after signing up for the service.
[deleted]
Re: Hetzner GPU Server
#50The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
Doesn’t this imply that it’s better to rent than to buy?
TANSTAAFL
1. Physical hardware is a useful abstraction.
2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course).
3. Rents can go up. Terms and Conditions can change. Credit cards can expire or be cancelled. In other words, renting introduces a significant dependency.
4. You are your own most important customer. Statistically, you are not The Clouds's most important customer. When The Clouds has a fault, it gets resolved based on its business model.
Engineering decisions are specific to a specific problem and all of them come with tradeoffs.