Rank #2,629 2,988 starsPython

chitu

by thu-pacman (organization)

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability. (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 2,988
Forks: 248
Open issues and pull requests: 60
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: thu-pacman · Organization
Created: Feb 20, 2025
Last push: Oct 13, 2026

Topics

Rank #2,629 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #2,629 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #2,629 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/thu-pacman--chitu.svg)](https://unitedstatesofamericasuperintelligence.com/github/thu-pacman--chitu/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/thu-pacman--chitu/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/thu-pacman--chitu.svg" alt="Ranked #2,629 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 6,523: mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
902 starsPythonApache-2.0Last push Oct 12, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 3,852: SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
1,874 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 7,564: pegainfer-project/pegainfer

Rank 6,523: mosecorg/mosec

Rank 43: vllm-project/vllm

Rank 3,852: SemiAnalysisAI/InferenceX

Rank 4,833: GradientHQ/parallax

Rank 6,501: zhihu/ZhiLight

Support Us