
vllm
by vllm-project (organization)
A high-throughput and memory-efficient inference and serving engine for LLMs (description from the project’s GitHub page)
Repository facts
- Stars
- 94,068
- Forks
- 23,543
- Open issues and pull requests
- 9,034
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- vllm-project · Organization
- Created
- Feb 9, 2023
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/vllm-project--vllm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/vllm-project--vllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/vllm-project--vllm.svg" alt="Ranked #43 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 3,852: SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
1,874 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 513: modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…
15,871 starsPythonApache-2.0Last push Oct 18, 2026