Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hetzner introduces GPU server for AI training

hetzner.com

Post reply on HN
Print view View original

41–50 of 57 posts

Re: Hetzner introduces GPU server for AI training

#41

Post by lutoma »

dindresto wrote: post #29
kirab wrote: post #24

Earlier quoted context omitted.

Hetzner customer here. It’s a little hard to understand in the UX, but the price shown is the monthly max price. It is actually paid by the hour. The price per hour for this server is € 1.5980 more info: https://docs.hetzner.com/general/others/new-billing-model/

That's incorrect, dedicated Hetzner servers do not have hourly pricing. That only applies to Hetzner Cloud.

No, they switched to per-hour billing for their dedicated servers a while ago. I also tested this last week when I cancelled a dedicated server we had with them and they did indeed only charge for part of the month.

Re: Hetzner introduces GPU server for AI training

#42

Post by nevi-me »

lutoma wrote: post #41
dindresto wrote: post #29

Earlier quoted context omitted.

That's incorrect, dedicated Hetzner servers do not have hourly pricing. That only applies to Hetzner Cloud.

No, they switched to per-hour billing for their dedicated servers a while ago. I also tested this last week when I cancelled a dedicated server we had with them and they did indeed only charge for part of the month.

There's a difference in being charged a partial amount for the month vs an hourly amount for something you need for just 2 hours.

I have a dedicated machine with Hetzner, and AFAIK they charge me the full amount regardless of whether it's on or off. If I cancel on day 3 of the month, it makes sense to be charged for only those days' hours. However that's different to "turn it on for 6 hours" kind of hourly pricing.

Re: Hetzner introduces GPU server for AI training

#43

Post by nevi-me »

kirab wrote: post #24
andersa wrote: post #6

Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).

Hetzner customer here. It’s a little hard to understand in the UX, but the price shown is the monthly max price. It is actually paid by the hour. The price per hour for this server is € 1.5980 more info: https://docs.hetzner.com/general/others/new-billing-model/

I'd read that hourly fee more as a comparative.

Re: Hetzner introduces GPU server for AI training

#44

Post by [deleted] »

nevi-me wrote: post #42
lutoma wrote: post #41

Earlier quoted context omitted.

No, they switched to per-hour billing for their dedicated servers a while ago. I also tested this last week when I cancelled a dedicated server we had with them and they did indeed only charge for part of the month.

There's a difference in being charged a partial amount for the month vs an hourly amount for something you need for just 2 hours. I have a dedicated machine with Hetzner, and AFAIK they charge me the full amount regardless of whether it's on or off. If I cancel on day 3 of the month, it makes sense to be charged for only those days' hours. However that's different to "turn it on for 6 hours" kind of hourly pricing.

[deleted]

Re: Hetzner introduces GPU server for AI training

#45

Post by lnxg33k1 »

reitzensteinm wrote: post #38
dindresto wrote: post #34

Earlier quoted context omitted.

Actually rechecking the terms of the GPU server, it states: > Cancellation period: 30 days to the end of the month To me that indicates it's not possible to order the server for only a few hours.

That term appears on all servers, but seems to be in conflict with their billing FAQ: https://docs.hetzner.com/general/others/new-billing-model/ Either way... it's a mess. They added hourly billing for dedicated servers six months ago, there's not much excuse for still having contradictory information hanging around.

I guess now with the pricing confusion they've fully embraced the cloud industry

Re: Hetzner introduces GPU server for AI training

#46

Post by justmarc »

jsheard wrote: post #3
justmarc wrote: post #2

Although R2 and B3 are excellent alternatives to S3, go get them Hetzner! Hetzner is a great, reliable company with fantastic offerings and excellent support.

I think you got your tabs mixed up, Hetzner did just launch an S3-like in beta but this post is about GPU boxes. https://docs.hetzner.com/storage/object-storage/overview

You're right, thanks

Re: Hetzner introduces GPU server for AI training

#47

Post by krick »

What's currently the cheapest/easiest way to deal with relatively lightweight GPU tasks, that are not lightweight enough for my PC?

Consider this use case: I want to upload 50 GB of audio somewhere and run whisper (biggest model) on it. I imagine the processing should be doable in minutes for a powerful GPU and must be very cheap, the script will be like 20 LOC, but I'll spend some time setting stuff up, uploading this and so on (which for example, makes colab a no-go for this). Any recommendations?

Also, when they say it's "per hour" do they mean an hour of GPU-time, or an hour of me "renting the equipment", so to say?

Re: Hetzner introduces GPU server for AI training

#48

Post by demarq »

krick wrote: post #47

What's currently the cheapest/easiest way to deal with relatively lightweight GPU tasks, that are not lightweight enough for my PC? Consider this use case: I want to upload 50 GB of audio somewhere and run whisper (biggest model) on it. I imagine the processing should be doable in minutes for a powerful GPU and must be very cheap, the script will be like 20 LOC, but I'll spend some time setting stuff up, uploading th…

Cerebrium

https://news.ycombinator.com/item?id=41579777

Re: Hetzner introduces GPU server for AI training

#49

Post by rafaelmn »

InvaderFizz wrote: post #26
rafaelmn wrote: post #21

Earlier quoted context omitted.

I don't see why. AMD could buy a lot of free community work just by putting out a 32 GB version of their next gen flagship at around 1k. Not chasing the margin for a generation would buy them a decent amount of community support - they need it if they want to compete with Nvidia at any point. Ahh I just saw OP was saying sub 100$ - yeah that's never going to happen.

VRAM is such a small portion of the BOM that they could double it, keep the same margins, and the MSRP would only increase by like $300. The problem isn't margin on the consumer cards, the problem is competing with their even higher margin workstation cards.

Thing is AMD can't have Nvidia margins because nobody supports them - take a hit for a generation on pro sales - get market/mind share and then you have a chance to play the same game.

Re: Hetzner introduces GPU server for AI training

#50

Post by rafaelmn »

lugao wrote: post #31
rafaelmn wrote: post #21

Earlier quoted context omitted.

I don't see why. AMD could buy a lot of free community work just by putting out a 32 GB version of their next gen flagship at around 1k. Not chasing the margin for a generation would buy them a decent amount of community support - they need it if they want to compete with Nvidia at any point. Ahh I just saw OP was saying sub 100$ - yeah that's never going to happen.

> next gen flagship at around 1k Have you seen GPU prices lately (last 5 years)? A RTX 4080 super with merely 16 GB of VRAM is at least 1k, there's no way a 32 GB next gen flagship would be released at this price range.

I don't see Nvidia canibalizing their server cash cow, but AMD has much less to lose and more to gain.
Post reply on HN