Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hetzner GPU Server

robot.hetzner.com

Post reply on HN
Print view View original

161–164 of 164 posts

Re: Hetzner GPU Server

#161

Post by petercooper »

petercooper wrote: post #107
petercooper wrote: post #30

I've just ordered one to ditz around with. We're early in the process of deploying our own internal server for Mixtral work, but it'll be interesting to see how this performs (in raw terms, almost certainly worse, since we can roll out a 4090 without getting into trouble – but Hetzner has a better connection and handles the maintenance, so..) Order has been accepted but not deployed yet. I'll update when I have some…

I got it after a few hours. You need to install drivers/CUDA yourself, but all very straightforward. Unfortunately due to having 20GB of VRAM, I'm limited to mixtral:8x7b-instruct-v0.1-q2_K but it runs fine, generating at about 40 tokens/s (65 tok/s for eval). As per official specs, it's running maxed out at 70W (being an SFF card). (I've now tried running the Q4 mixtral which is 26GB. 18GB is on GPU, 8GB through CPU…

To compare, running Ollama with Q4 Mixtral on my 24GB 3090 Ti locally (with 22.5GB of the 26GB model on the GPU) I get 14 tok/s generation, so the Hetzner server and the 4000 really aren't bad at all (notably my 3090 draws 70W during inference also).

Re: Hetzner GPU Server

#162

Post by hipadev23 »

15457345234 wrote: post #157
hipadev23 wrote: post #147

Earlier quoted context omitted.

I run a legitimate non-sleazy business in the US doing mid 7 figures a year. It’s not a “line”, it was the reality of an attempt to do business with Hetzner. I’ve never had any serious issues with other vps, colo, dedicated, or cloud providers in 25 years as an employee of many companies or as a business owner: only Hetzner.

> It’s not a “line”, it was the reality I'm not saying it isn't true, I'm just saying that there's no way you can describe criticism of Hetzner being 'silenced' on HN; criticism is literally a defining facet of Hetzner threads.

Downvotes til grey/flagged = silenced. Which is accurate of nearly every negative comment about Hetzner on HN.

Re: Hetzner GPU Server

#163

Post by thijsvandien »

Hetzner_OL wrote: post #152

Hi there, Thanks for helping to spread the news about our new GPU server, the GEX44. Please keep in mind that it’s not like we don’t want you to open an account – it’s more about safety & security. In general, we take extra precautions when it comes to verifying accounts and accepting new customers, as in these cases the potential of abuse of our ToC are higher. As a reliable hosting partner, we always take the time…

A reliable partner does not close accounts without any kind of recourse. Denying that under the guise of fraud prevention is just security through obscurity. I hope these practices become illegal sooner rather than later. Never before have I been treated as a criminal as much for trying to do legitimate business, and it’s quite the experience.
Post reply on HN