Live data from Hacker News

Hetzner is working on LLM Inference

sliplane.io

41–50 of 92 posts

Re: Hetzner is working on LLM Inference

#42
post #24

Earlier quoted context omitted.

nobody writes like that. the article is based on a prompt, which i would much rather read, instead of the ironed out version that the llm produced

fine, i agree that this doesnt sound like me. But the content is correct and not a hallucination!

so did you write this post with the assistance of LLMs?

Re: Hetzner is working on LLM Inference

#43

Earlier quoted context omitted.

Never understood why hetzner gets brought up so positively here when there are dozens of EU competitors who are just as good and don't run 7 year old discounted servers

Because nobody ever mentions them by name, leaving all of us in the dark.

Upcloud, Scaleway, Clever cloud, etc.

Re: Hetzner is working on LLM Inference

#45
post #38

Earlier quoted context omitted.

We need frontier open weight models from the West. Maybe Nvidia's Nemotron can get there. https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/

There is no "West" anymore, at least not in the sense it was used in the last 50–70 years. There is now Europe/Canada/Australia on the one side, and the USA as an adversary on the other, and that won't change in the foreseeable time. What we need is frontier open weight models in the EU, Canada, and Australia.

Give it two years more then it changes again.

Re: Hetzner is working on LLM Inference

#46

This seems like a smart move, given their ability to host efficiently. I approve of efforts to make the cost of inference for smaller useful models slowly approach 'close to zero' and there are many good paths for getting there. It is useful for companies to get fast hosting for the class of smaller models they may end up hosting in house.

Problem is right now the biggest GPU boxes they have is single rtx pro 6000s.

Re: Hetzner is working on LLM Inference

#48

Earlier quoted context omitted.

Because nobody ever mentions them by name, leaving all of us in the dark.

Upcloud, Scaleway, Clever cloud, etc.

These are all solid choices, but significantly less performance/€

Understandably too, because hetzner is running things on consumer hardware vs the enterprise hardware the others use

Re: Hetzner is working on LLM Inference

#49
post #24

Earlier quoted context omitted.

what is the hallucination here? it is fast, free and fun to try. And I genuinely think that the hardware decision (if they get bigger gpus) decides if this will be a banger product or not?

nobody writes like that. the article is based on a prompt, which i would much rather read, instead of the ironed out version that the llm produced

> the article is based on a prompt, which i would much rather read

I would much rather read someone's carefully written and LLM-assissted article than shallow and lazy dismissals like this one. What, precisely, do you feel you've added to the conversation here?

Post reply on HN