Rank #4,383 1,601 starsC++

xllm

by xLLM-AI (organization)

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation. (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 1,601
Forks: 313
Open issues and pull requests: 218
Primary language: C++
License: Apache License 2.0 (Apache-2.0)
Owner: xLLM-AI · Organization
Created: Aug 12, 2025
Last push: Oct 18, 2026

Topics

Rank #4,383 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #4,383 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #4,383 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/xllm-ai--xllm.svg)](https://unitedstatesofamericasuperintelligence.com/github/xllm-ai--xllm/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/xllm-ai--xllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/xllm-ai--xllm.svg" alt="Ranked #4,383 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 8,611: zhongkaifu/TensorSharp
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-comp…
592 starsC#BSD-3-ClauseLast push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 3,852: SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
1,874 starsPythonApache-2.0Last push Oct 18, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 8,611: zhongkaifu/TensorSharp

Rank 7,564: pegainfer-project/pegainfer

Rank 185: sgl-project/sglang

Rank 4,833: GradientHQ/parallax

Rank 1,389: gpustack/gpustack

Rank 3,852: SemiAnalysisAI/InferenceX

Support Us