Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hetzner GPU Server

robot.hetzner.com

Post reply on HN
Print view View original

21–30 of 164 posts

Re: Hetzner GPU Server

#21

Post by sshagent »

gokhan wrote: post #5
ecmascript wrote: post #2

Not really related to their GPU offering but Hetzner is such a great company. I have a dedicated server I rented where I host all of my side projects. For the same price as one shitty VPS I get 8 cores, 64GB ram and a disk of 240GB or something like that. Just incredible, response times are incredibly low and there is no cap on data. The few times I have contacted support they've been great. The only times I have exp…

Had a server with them for more than 10 years. Had they eliminated the setup fee, they would get more of my money for sure for small projects.

They often have a couple of servers with no setup.

Re: Hetzner GPU Server

#22

Post by rmbyrro »

greatNespresso wrote: post #4

Is Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.

You have to discount the price of a similar server without the GPU, tough.

But even so, it's still quite expensive. I have the impression Nvidia charges more from data center customers. So, for cards available to retail consumers, it's not a fair cost comparison.

With only 20GB, RTX 4000 has limited use... I was expecting they'd be offering something with at least 60GB at this point.

Re: Hetzner GPU Server

#23

Post by aborsy »

The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failure, time wasted in dealing with hardware, etc.

On hetzner it all costs less than 100$ per month. Doesn’t this imply that it’s better to rent than to buy?

Re: Hetzner GPU Server

#24

Post by kookamamie »

Aerroon wrote: post #18
greatNespresso wrote: post #4

Is Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.

Why does this GPU cost so much? It seems to be like an RTX 3060 Ti/3070 with more VRAM and less power draw. Does that really justify the price tag?

Because it's "enterprise".

Re: Hetzner GPU Server

#25

Post by throwaway11460 »

aborsy wrote: post #23

The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…

Yes, the volume discounts and economies of scale they can get (while you can't) are insane.

Re: Hetzner GPU Server

#26

Post by kookamamie »

greatNespresso wrote: post #4

Is Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.

No, not a great GPU for training. Consider something like A5000, A6000 or their Ada variants - if you want to go full "data-center", A40, L40, L40S are solid picks for small-scale training.

Re: Hetzner GPU Server

#27

Post by throwaway11460 »

gowthamgts12 wrote: post #14
gokhan wrote: post #9

Earlier quoted context omitted.

Yes. I'm talking about occasional needs for a small server for a month or two.

Why not go with hertzner cloud? No setup fees and you'll be billed by the usage. Still cheaper than other cloud providers.

The VM performance tax is huge. Also, no GPU and limited/paid traffic (large limit though).

Re: Hetzner GPU Server

#28

Post by HPsquared »

Aerroon wrote: post #18
greatNespresso wrote: post #4

Is Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.

Why does this GPU cost so much? It seems to be like an RTX 3060 Ti/3070 with more VRAM and less power draw. Does that really justify the price tag?

Like Apple, they use RAM for market segmentation.

Re: Hetzner GPU Server

#29

Post by petercooper »

Aerroon wrote: post #18
greatNespresso wrote: post #4

Is Nvidia RTX 4000 solid for training? Alternatively this card seems listed for around $1800 so at $180/month on Hetzner, it may be even cheaper to buy it, depending on the expected usage.

Why does this GPU cost so much? It seems to be like an RTX 3060 Ti/3070 with more VRAM and less power draw. Does that really justify the price tag?

NVIDIA's licensing. Note that the 3060/3070 is a "GeForce" whereas a 4000 is a "Quadro". Then look at the GeForce driver EULA: https://www.nvidia.com/content/DriverDownloads/licence.php?l...

> No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted.

I could never figure out why they allowed blockchain processing, given how wasteful much of it was and how it impacted card supply for years, but there you go.

Re: Hetzner GPU Server

#30

Post by petercooper »

I've just ordered one to ditz around with. We're early in the process of deploying our own internal server for Mixtral work, but it'll be interesting to see how this performs (in raw terms, almost certainly worse, since we can roll out a 4090 without getting into trouble – but Hetzner has a better connection and handles the maintenance, so..) Order has been accepted but not deployed yet. I'll update when I have some initial inference numbers.
Post reply on HN