Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hetzner GPU Server

robot.hetzner.com

Post reply on HN
Print view View original

51–60 of 164 posts

Re: Hetzner GPU Server

#51

Post by singhrac »

throwaway11460 wrote: post #25
aborsy wrote: post #23

The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…

Yes, the volume discounts and economies of scale they can get (while you can't) are insane.

One of the simplest is that data center energy pricing is just simply different from residential energy, because they often get wholesale (plus small markup) rather than residential rates.

Re: Hetzner GPU Server

#52

Post by Aerroon »

petercooper wrote: post #29
Aerroon wrote: post #18

Earlier quoted context omitted.

Why does this GPU cost so much? It seems to be like an RTX 3060 Ti/3070 with more VRAM and less power draw. Does that really justify the price tag?

NVIDIA's licensing. Note that the 3060/3070 is a "GeForce" whereas a 4000 is a "Quadro". Then look at the GeForce driver EULA: https://www.nvidia.com/content/DriverDownloads/licence.php?l... > No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted. I could never figure out why they allowed blockchain processing, given how wastef…

This seems insane to me. It makes me even more confused that AMD/Intel aren't trying their hardest to go after AI compute. Nvidia is basically leaving the door open.

But I suppose that the idea could be to protect their gaming market in a way. If datacenters were buying up gaming GPUs then that could cause shortages for regular customers.

Re: Hetzner GPU Server

#53

Post by SushiHippie »

alberth wrote: post #19
SushiHippie wrote: post #16

FWIW, on the server auction, you could get GPU servers since a while: https://www.hetzner.com/sb/#additional=GPU Looks like currently there are only GTX 1080s on the server auction, I don't know if they normally have other GPUs available as well.

Nvidia RTX 4000 SFF Ada From the OP link, the GPU-Server GEX44 server line includes RTX 4000. And the server only cost €184/month.

I meant if they have other GPUs normally available in the server auction. As far as I understand the servers in the server auction are mostly custom built ones for customers and once they stop renting them they land on the server auction for others to rent.

The one with the RTX 4000 seems to be a standardized line of products.

Re: Hetzner GPU Server

#54

Post by bbatsell »

8organicbits wrote: post #47
pmontra wrote: post #34

Earlier quoted context omitted.

Because they made a lot of money selling to miners at prices that maybe they couldn't ask to gamers?

Wouldn't the GeForce license then say "no block chain" and a different NVIDIA brand (BlockForce?) would allow it, letting NVDA charge more for large scale mining? Otherwise it looks like gamers and miners are paying the same prices.

They do. But since most miners would just ignore the license, they implemented LHR (low hashrate) beginning on GeForce 3000-series that detects the types of ops used for mining and artificially slows the GPU to about 25% of its actual speed.

Re: Hetzner GPU Server

#55

Post by YetAnotherNick »

Scotrix wrote: post #46
YetAnotherNick wrote: post #44

Earlier quoted context omitted.

It's definitely weird that cloud costs which is supposed to be commoditized is differing by 2 orders of magnitude. Hetzner/OVH seemed to have solved the hard part of making the service cheaper but just can't solve the easier task of making the platform usable. Why do I need to upload documents for verification. Why can't I try server for 2 hours right after signing up for the service.

Have been in deep contact with data centre and rental server offerings in the past, there is a crazy large amount of fraud going on, e.g. 2 hours for free means 2 hours free resource to DDOS.

I don't want it free. I want to put $2 on the account. Try the server and decide after using the server.

Re: Hetzner GPU Server

#56

Post by formerly_proven »

singhrac wrote: post #51
throwaway11460 wrote: post #25

Earlier quoted context omitted.

Yes, the volume discounts and economies of scale they can get (while you can't) are insane.

One of the simplest is that data center energy pricing is just simply different from residential energy, because they often get wholesale (plus small markup) rather than residential rates.

The majority of residential rates (about 40 ct/kWh) are taxes and levies, not the actual price of the electricity. That's why industrial rates can be less than half of residential rates.

Re: Hetzner GPU Server

#57

Post by throwaway11460 »

formerly_proven wrote: post #56
singhrac wrote: post #51

Earlier quoted context omitted.

One of the simplest is that data center energy pricing is just simply different from residential energy, because they often get wholesale (plus small markup) rather than residential rates.

The majority of residential rates (about 40 ct/kWh) are taxes and levies, not the actual price of the electricity. That's why industrial rates can be less than half of residential rates.

Can you be more specific? What kind of taxes? VAT is paid by the end consumer so you're not getting out of that one. Are there special consumption taxes on electricity in Germany?

In my experience the largest difference is distribution cost. The mandated distribution monopoly charges a lot (regulated price) to small customers.

Re: Hetzner GPU Server

#58

Post by thatwasunusual »

ecmascript wrote: post #2

Not really related to their GPU offering but Hetzner is such a great company. I have a dedicated server I rented where I host all of my side projects. For the same price as one shitty VPS I get 8 cores, 64GB ram and a disk of 240GB or something like that. Just incredible, response times are incredibly low and there is no cap on data. The few times I have contacted support they've been great. The only times I have exp…

Ditto.

Been using them since 2012 or something, and have never had a problem (that wasn't my own fault).

Re: Hetzner GPU Server

#59

Post by zimpenfish »

sjsdaiuasgdia wrote: post #39
bluedino wrote: post #20

Earlier quoted context omitted.

I'm not sure what the exact 'rule' is here, but you wouldn't use a contraction in this sentence. It is, with ample RAM and the latest CPU.

From https://www.yourdictionary.com/articles/contractions-correct... - Contractions can be used in any position in a sentence; however, homophone contractions such as "it's" and "they're" sound better when followed by another word or phrase. The reason is that the sounds of "its" and "it's" and "they're" and "their" are so similar that they can be confusing unless they are used with the context of an additional word.

To be fair, the contracted version doesn't read nearly as nicely.

    Q. Is it good for training?
    A. It's with ample RAM and the latest Intel CPU.
vs

    Q. Is it good for training?
    A. It is with ample RAM and the latest Intel CPU.

Re: Hetzner GPU Server

#60

Post by Dalewyn »

brudgers wrote: post #50
aborsy wrote: post #23

The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…

Doesn’t this imply that it’s better to rent than to buy? TANSTAAFL 1. Physical hardware is a useful abstraction. 2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course). 3. Rents can go up. Terms and Conditions can change. Credit cards can expire or be cancelled. In other words, renting introduces a significant dependency. 4. You are your own most important customer.…

>2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course).

This is huge and often overlooked or undervalued. Renting means you have nothing when the contract ends, buying means you have something for your money spent.

Post reply on HN