dstack (K8s alternative) adds support for AMD accelerators on RunPod(dstack.ai)
dstack.ai
dstack (K8s alternative) adds support for AMD accelerators on RunPod
https://dstack.ai/blog/amd-on-runpod/
5 comments
Hi, I’m one of the contributors to dstack! Yes, you’re absolutely right—the title is a bit off. It should be "K8S for AI Teams Only." And yes, there is a lot of focus on LLMs specifically. If you have any other feedback, please share it!
I think framing it as being able to run LLMs with ease and portability across machines and hardware is an amazing sell. Most guides are very technical and detailed that it’s a barrier for many to self host.
it appears you have borked all the doc links from your readme (e.g.) https://github.com/dstackai/dstack#1-define-configurations
Oops, thanks for sharing this! Gonna update it shortly.
Looking forward to trying dStack to deploy NVIDIA NIM and NeMo Microservices.
That’s on our list! We’re actually planning to expand our examples page with a lot more frameworks! Contributors are very welcome to our repo: https://github.com/dstackai/dstack/tree/master/examples/
We (Hot Aisle) are looking forward to supporting dstack on our MI300x systems as well. They are doing great work.
[deleted]
Maybe it’s k8s alternative for AI/LLM!