
llm-d
by llm-d (organization)
Achieve state of the art inference performance with modern accelerators on Kubernetes (description from the project’s GitHub page)
Repository facts
- Stars
- 4,856
- Forks
- 858
- Open issues and pull requests
- 100
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- llm-d · Organization
- Created
- Apr 29, 2025
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/llm-d--llm-d/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/llm-d--llm-d/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/llm-d--llm-d.svg" alt="Ranked #1,655 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 3,293: dstackai/dstack
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clus…
2,284 starsPythonMPL-2.0Last push Oct 17, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 8,576: Nehanth/pooled
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
596 starsJavaScriptMITLast push Oct 16, 2026
Rank 3,339: kubeflow/trainer
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
2,249 starsGoApache-2.0Last push Oct 16, 2026
Rank 3,348: theagentrouter/agent-router
Manages Unified Access to Generative AI Services built on Envoy Gateway
2,240 starsGoApache-2.0Last push Oct 16, 2026
Rank 9,121: kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
539 starsGoMITLast push Oct 12, 2026