11–20 of 57 posts
Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
How long I wonder before these sorts of things will be affordable to the more everyday person say sub-$100?
Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
What’s the most cost effective option for hosting an llm these days? I don’t need to train, I just want to use one of the llama models for inference to reduce my reliance on 3rd parties.
Earlier quoted context omitted.
How long I wonder before these sorts of things will be affordable to the more everyday person say sub-$100?
Not before the bubble pops.
So 1kEUR/month for a 6kEUR GPU. Pretty sure there are a lot of drug dealers who wish they had gone into cloud training instead.
Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
That's not a like-for-like comparison, though. ~2TB local NVMe storage included here, 10 (70%) more CPU cores, and more than twice the RAM.
So 1kEUR/month for a 6kEUR GPU. Pretty sure there are a lot of drug dealers who wish they had gone into cloud training instead.