Rank #6,501 907 starsC++

ZhiLight

by zhihu (organization)

A highly optimized LLM inference acceleration engine for Llama and its variants. (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 907
Forks: 109
Open issues and pull requests: 6
Primary language: C++
License: Apache License 2.0 (Apache-2.0)
Owner: zhihu · Organization
Created: Dec 6, 2024
Last push: Mar 18, 2026

Topics

Rank #6,501 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,501 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,501 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/zhihu--zhilight.svg)](https://unitedstatesofamericasuperintelligence.com/github/zhihu--zhilight/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/zhihu--zhilight/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/zhihu--zhilight.svg" alt="Ranked #6,501 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 8,484: andrewkchan/yalm
Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
604 starsC++No license file detectedLast push Sep 13, 2025
Rank 4,923: alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
1,362 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 3,967: ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
1,807 starsPythonApache-2.0Last push Oct 18, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 43: vllm-project/vllm

Rank 7,564: pegainfer-project/pegainfer

Rank 8,484: andrewkchan/yalm

Rank 4,923: alibaba/rtp-llm

Rank 1,389: gpustack/gpustack

Rank 3,967: ovg-project/kvcached

Support Us