
Mooncake
by kvcache-ai (organization)
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. (description from the project’s GitHub page)
Repository facts
- Stars
- 6,826
- Forks
- 1,349
- Open issues and pull requests
- 775
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- kvcache-ai · Organization
- Created
- Jun 25, 2024
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/kvcache-ai--mooncake/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/kvcache-ai--mooncake/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/kvcache-ai--mooncake.svg" alt="Ranked #1,183 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 3,967: ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
1,807 starsPythonApache-2.0Last push Oct 18, 2026
Rank 8,348: smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV ca…
618 starsRustApache-2.0Last push Oct 18, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 3,852: SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
1,874 starsPythonApache-2.0Last push Oct 18, 2026
Rank 9,093: spark-arena/sparkrun
sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD
543 starsPythonApache-2.0Last push Oct 18, 2026