131–140 of 164 posts
I have no idea where the NVIDIA RTX 4000 SFF belongs in the hierarchy of speed and suitability for "AI" computing.
How does this compare to a NVIDIA A800 40G? (if that is still considered good, I can't keep up)
To me the RTX part of the name sounds more on the consumer side but I am probably wrong about that as well.
That card is about $1500: https://www.amazon.com/dp/B0C2KMXQYG
The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
Also keep in mind that hetzner is mostly a beowulf cluster. See e.g. this press picture from their newsroom page: https://cdn.hetzner.com/assets/Uploads/IMG-0546-91.jpg
They do have dell servers, too. But don't expect to run on one of these nodes unless the machine type has Dell / PowerEdge in their name. This means the management capabilities are minimal (but usually enough). A fully licensed management card can do way more.
Their renting pricing is ridiculously cheap though. Hardware failure is more common than on cloud providers (see cluster hardware), support has been helpful in the past. Overall IMHO a good choice if you are price sensitive. But even then consider development vs. deployment vs. running (server) costs. Servers might make up less of the total cost of a service than you expect.
Earlier quoted context omitted.
Signed up from an Asian country and during signup they asked me to upload a passport copy page. I thought that was weird (I mean no other cloud provider asked for it but okay). I uploaded anyway because I thought it’s in EU so they at least have better privacy laws so they may end up deleting it later from their systems but I immediately got rejected. Not sure why no reason specified. So now they have my passport cop…
Hetzner is pretty hostile towards foreigners. And don't you dare suggest in their forum that foreign tech is better than German, instaban. Fuck Hetzner
It looks like a good value for money, but immediately after registering, I get this reply "After reviewing your updated customer information, we have decided to deactivate your account because of some concerns we have regarding this information. Therefore, we have cancelled all your existing products and orders with us." Someone has a similar experience? I've tried it twice, filled everything truthfuly, valid credit…
The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
Last time I checked the GCP prices vs. hetzner servers there was a factor of 10 in monthly cost. So I cant say this is a general rule of thumb. It is true though that hetzner can provide superb performance per $. Potentially below what you can do (unless you buy racks of hardware). Also keep in mind that hetzner is mostly a beowulf cluster. See e.g. this press picture from their newsroom page: https://cdn.hetzner.com…
Therefore, I'd argue that if you require continuous, raw computing power, Hetzner is indeed cost-effective. However, the cost-effectiveness elsewhere really hinges on your usage patterns.
Just make sure any workloads you place on Hetzner are treated as spot instances and outputs are immediately sent off network. The reliability of their systems and customer support is very low. Hetzner is a 5-star or 1-star company. Are you willing to risk your business on the flip of a coin? My own experience [2] was definitely a 1-star. [1] https://www.trustpilot.com/review/hetzner.com [2] https://news.ycombinator.c…
Trustpilot is a scam which encourages bad reviews to force companies to buy their paid plan to “manage” those bad reviews and to feed it good reviews.
Earlier quoted context omitted.
>2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course). This is huge and often overlooked or undervalued. Renting means you have nothing when the contract ends, buying means you have something for your money spent.
A 3 year depreciation cycle may be reasonable for some spaces but not others. I'm not going to lose sleep over not getting firmware updates; when they've got all the bugs on my stuff ironed out I don't want more firmware updates. I haven't done the spreadsheet work to identify the cross-over point for where old systems become uneconomical but when I've done it in the past for my heavily clustered workloads it's typic…
Exactly.
I am running a server at Hetzner which has a CPU that was discontinued about 7 years ago. I don't know the exact age of the machine because it was already used when I got it 4 years ago, but based on the CPU availability it's at least 7 or 8 years old, potentially even older.
Nothing on that machine has failed in the last 4 years except for HDDs (the spinning platter type), which are immediately swapped when broken, RAID rebuilds, everything's fine.
3 years is no time for hardware nowadays. It can live much longer, especially if storage is solid-state. And the performance improvements often aren't substantial enough to warrant a swap within anything shorter than 5 or 6 years.
