Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hetzner GPU Server

robot.hetzner.com

Post reply on HN
Print view View original

151–160 of 164 posts

Re: Hetzner GPU Server

#151

Post by ecmascript »

pmontra wrote: post #40
ecmascript wrote: post #2

Not really related to their GPU offering but Hetzner is such a great company. I have a dedicated server I rented where I host all of my side projects. For the same price as one shitty VPS I get 8 cores, 64GB ram and a disk of 240GB or something like that. Just incredible, response times are incredibly low and there is no cap on data. The few times I have contacted support they've been great. The only times I have exp…

Which server do you have on Hetzner that I missed? Dedicated servers start at 37.30 Euro per month now there, the AX-41 couch is pretty good and has no setup fee. On the other side I'm paying OVH about 12 Euro per month for two small VPSes and they are even too much for me, performance wise.

I have a dedicated server that I got on their auction page for 30 euro per month. That gives me 64GB of ram, 8 cores and some disk space.

Sure, you can get a cheaper VPS, but given a VPS with the approx same perf it would cost much more.

Re: Hetzner GPU Server

#152

Post by Hetzner_OL »

Hi there, Thanks for helping to spread the news about our new GPU server, the GEX44. Please keep in mind that it’s not like we don’t want you to open an account – it’s more about safety & security. In general, we take extra precautions when it comes to verifying accounts and accepting new customers, as in these cases the potential of abuse of our ToC are higher. As a reliable hosting partner, we always take the time to listen to our customers and will do our best to find a solution for each case. So feel free to reach out to us if you need further assistance. --Katie

Re: Hetzner GPU Server

#153

Post by zimpenfish »

bluedino wrote: post #65
zimpenfish wrote: post #59

Earlier quoted context omitted.

To be fair, the contracted version doesn't read nearly as nicely. Q. Is it good for training? A. It's with ample RAM and the latest Intel CPU. vs Q. Is it good for training? A. It is with ample RAM and the latest Intel CPU.

I think they are agreeing with it not reading as nicely. But you still need the comma. Otherwise it sounds like: "It is with great pleasure..."

I don't think you necessarily need the comma but it would depend on the reader, I think. I didn't need the comma to read it correctly but I can see how you might mentally insert a pause between "it is" and "with" that makes it read weirdly.

Probably better to reorganise it as "With ample ram [...], it is."

Re: Hetzner GPU Server

#154

Post by kookamamie »

stefan_ wrote: post #32
Aerroon wrote: post #18

Earlier quoted context omitted.

Why does this GPU cost so much? It seems to be like an RTX 3060 Ti/3070 with more VRAM and less power draw. Does that really justify the price tag?

Datacenter customers don't have options, gamers do.

RTX 4000 isn't even data-center grade - it's workstation/pro segment. This is an important difference, as some server vendors (such as Dell) will not validate the workstation segment to run in their servers.

The segmentation is a huge mess from NVIDIA. Consumer grade GPUs aren't supposed to be run in data-center / compute (forbidden by EULA) and the workstation GPUs are in a weird middleground limbo, being many times more expensive, but not exactly attractive for server use for the above reasons.

Re: Hetzner GPU Server

#155

Post by petercooper »

syntaxing wrote: post #149
petercooper wrote: post #30

I've just ordered one to ditz around with. We're early in the process of deploying our own internal server for Mixtral work, but it'll be interesting to see how this performs (in raw terms, almost certainly worse, since we can roll out a 4090 without getting into trouble – but Hetzner has a better connection and handles the maintenance, so..) Order has been accepted but not deployed yet. I'll update when I have some…

I never deployed it professionally but wouldn’t getting a Mac Studio be a better run for your money if you’re only inferencing?

Possibly. It's not a bad idea! The performance is pretty good in our initial tests, though cloud platforms do scale further in terms of concurrency.

Given how quickly things are changing, using more generic hardware (i.e. PCs and Nvidia cards) or leasing cloud based services might make more business sense in the long term, so investigating fallbacks with more control, like this server, are worthwhile experiments anyway.

Further, while I've been an Apple superfan for a couple of decades now, their recent attitude towards developers stinks, and I'm loathe to give them any more money than I need to right now, so I might be migrating away from the platform in any case.

Re: Hetzner GPU Server

#156

Post by k8sToGo »

brudgers wrote: post #124
k8sToGo wrote: post #74

Earlier quoted context omitted.

You forgot that Hetzner also has spare parts.

And Dells have warranties. And both offer service agreements. And Hetzner is a straight line expense while a Dell might be a depreciating asset. And either both or neither may offer discounts off retail. And so on. Because that’s the nature of actual decisions versus online arguments.

If you want to host your own stuff then you have to have spare parts in stock.

Not the same as waiting for dell to RMA your GPU over days.

Re: Hetzner GPU Server

#157

Post by 15457345234 »

hipadev23 wrote: post #147
15457345234 wrote: post #146

Earlier quoted context omitted.

Negative feedback is silenced? Dude the characteristic feature of Hetzner threads on HN is a bunch of people in the comments moaning about having to scan their passport or repeating the 'they just turn your servers off with no warning' line. In fact it's so prevalent and consistent - at least here - that to my eye it looks to me like black PR. Or that they're really good at rooting out internet scumbags and that the…

I run a legitimate non-sleazy business in the US doing mid 7 figures a year. It’s not a “line”, it was the reality of an attempt to do business with Hetzner. I’ve never had any serious issues with other vps, colo, dedicated, or cloud providers in 25 years as an employee of many companies or as a business owner: only Hetzner.

> It’s not a “line”, it was the reality

I'm not saying it isn't true, I'm just saying that there's no way you can describe criticism of Hetzner being 'silenced' on HN; criticism is literally a defining facet of Hetzner threads.

Re: Hetzner GPU Server

#159

Post by hnbad »

throwaway11460 wrote: post #57
formerly_proven wrote: post #56

Earlier quoted context omitted.

The majority of residential rates (about 40 ct/kWh) are taxes and levies, not the actual price of the electricity. That's why industrial rates can be less than half of residential rates.

Can you be more specific? What kind of taxes? VAT is paid by the end consumer so you're not getting out of that one. Are there special consumption taxes on electricity in Germany? In my experience the largest difference is distribution cost. The mandated distribution monopoly charges a lot (regulated price) to small customers.

A friend of mine is an electrician in Germany who had a lengthy discussion about this with another friend of mine who was drunkenly complaining about how large corporations pay less for electricity. I'll try my best to reconstruct what he said in response.

Residential customers use highly variable amounts of electricity and typically pay a base rate in addition to usage which can have different tiers so additional use may get cheaper if you exceed a certain threshold. Often these contracts also offer month-by-month cancellation or may include a certain period for which the price is guaranteed not to change.

Industrial customers instead often buy bulk volume commitments. Instead of paying per use, they commit to using a certain amount and pay for that exactly. They also generally have much longer running contracts. There are also contracts that directly tie the price to the daily (or in some cases even hourly) market rate, which is usually not an option for residential customers. Their energy use is also generally more predictable than the load required for residential areas with the equivalent consumption so the cost for running and maintaining the grid is lower. Additionally there is a recent trend towards DC power delivery, further cutting costs.

Rooftop solar panels and domestic EV charging actually contribute to the cost of maintaining residential grids because they add to the peak load and variance, both of which have to be compensated for. In other words, per unit of energy sold, residential customers simply have more overhead than large scale business customers.

Re: Hetzner GPU Server

#160

Post by ofrzeta »

dist-epoch wrote: post #75
wongarsu wrote: post #42

Earlier quoted context omitted.

Hetzner is not only able to get better volume discounts, they also spend a lot of engineering time bringing down costs, and have decades of experience doing so. They offer some Dell Servers for those that really want them, but most of their servers have a custom mix of consumer hardware, server hardware and in-house hardware (for example they use their own racking system), optimized to minimize lifetime cost in a dat…

Hetzner is buying ASUS consumer AM5 motherboards, but with the whole CPU + memory block rotated so that the memory sticks are horizontal instead of vertical for better airflow: https://www.youtube.com/watch?v=V2P8mjWRqpk

They have lots of different boards, among others ASRock. Even within the same range of models you can buy, for instance AX52 you can get different manufacturers. It's not really transparent to the customers when they order.

Source: dmidecode

Post reply on HN