dstack (K8s alternative) adds support for AMD accelerators on RunPod
1–10 of 10 posts
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#2[deleted]
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#3How is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads?
Maybe it’s k8s alternative for AI/LLM!
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#4it appears you have borked all the doc links from your readme (e.g.) https://github.com/dstackai/dstack#1-define-configurations
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#5How is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads? Maybe it’s k8s alternative for AI/LLM!
Hi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#6it appears you have borked all the doc links from your readme (e.g.) https://github.com/dstackai/dstack#1-define-configurations
Oops, thanks for sharing this! Gonna update it shortly.
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#7We (Hot Aisle) are looking forward to supporting dstack on our MI300x systems as well. They are doing great work.
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#8Looking forward to trying dStack to deploy NVIDIA NIM and NeMo Microservices.
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#9Looking forward to trying dStack to deploy NVIDIA NIM and NeMo Microservices.
That’s on our list! We’re actually planning to expand our examples page with a lot more frameworks! Contributors are very welcome to our repo: https://github.com/dstackai/dstack/tree/master/examples/
Re: dstack (K8s alternative) adds support for AMD accelerators on RunPod
#10How is this k8s alternative when the homepage is focusing about running LLM models and AI content in containers rather than being for all workloads? Maybe it’s k8s alternative for AI/LLM!
Hi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
I think framing it as being able to run LLMs with ease and portability across machines and hardware is an amazing sell. Most guides are very technical and detailed that it’s a barrier for many to self host.