Nanoflow
by efeslab (organization)
A throughput-oriented high-performance serving framework for LLMs (description from the project’s GitHub page)
Repository facts
- Stars
- 976
- Forks
- 54
- Open issues and pull requests
- 19
- Primary language
- Jupyter Notebook
- License
- No license file detected
- Owner
- efeslab · Organization
- Created
- Aug 19, 2024
- Last push
- Mar 29, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/efeslab--nanoflow/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/efeslab--nanoflow/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/efeslab--nanoflow.svg" alt="Ranked #6,203 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026
Rank 2,619: vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2,996 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,923: alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
1,362 starsPythonApache-2.0Last push Oct 18, 2026