Rank #1,847 4,327 starsPython

LightLLM

by ModelTC (organization)

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance. (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 4,327
Forks: 375
Open issues and pull requests: 179
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: ModelTC · Organization
Created: Jul 22, 2023
Last push: Oct 18, 2026

Topics

Rank #1,847 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #1,847 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #1,847 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/modeltc--lightllm.svg)](https://unitedstatesofamericasuperintelligence.com/github/modeltc--lightllm/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/modeltc--lightllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/modeltc--lightllm.svg" alt="Ranked #1,847 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,923: alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
1,362 starsPythonApache-2.0Last push Oct 18, 2026
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 768: bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10,639 starsPythonMITLast push Sep 7, 2024
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026
Rank 2,065: yuanzhoulvpi2017/zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
3,842 starsJupyter NotebookMITLast push Aug 5, 2025

Repository facts

Topics

Add this badge to your README

Related projects

Rank 43: vllm-project/vllm

Rank 4,923: alibaba/rtp-llm

Rank 64: hiyouga/LlamaFactory

Rank 768: bigscience-workshop/petals

Rank 6,501: zhihu/ZhiLight

Rank 2,065: yuanzhoulvpi2017/zero_nlp

Support Us