rtp-llm
by alibaba (organization)
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,362
- Forks
- 284
- Open issues and pull requests
- 238
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- alibaba · Organization
- Created
- Dec 27, 2023
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/alibaba--rtp-llm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/alibaba--rtp-llm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/alibaba--rtp-llm.svg" alt="Ranked #4,923 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 2,619: vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2,996 starsPythonApache-2.0Last push Oct 18, 2026
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026
Rank 922: bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
8,906 starsPythonApache-2.0Last push Oct 5, 2026
Rank 645: bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
12,559 starsPythonApache-2.0Last push Oct 12, 2026