Rank #3,852 1,874 starsPython

InferenceX

by SemiAnalysisAI (organization)

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台 (description from the project’s GitHub page)

Repository facts

Stars: 1,874
Forks: 332
Open issues and pull requests: 327
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: SemiAnalysisAI · Organization
Created: Jul 12, 2025
Last push: Oct 18, 2026

Topics

Rank #3,852 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #3,852 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #3,852 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/semianalysisai--inferencex.svg)](https://unitedstatesofamericasuperintelligence.com/github/semianalysisai--inferencex/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/semianalysisai--inferencex/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/semianalysisai--inferencex.svg" alt="Ranked #3,852 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 669: LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
12,108 starsPythonApache-2.0Last push Oct 18, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,372: lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
5,927 starsC++Apache-2.0Last push Oct 18, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 1,389: gpustack/gpustack

Rank 7,564: pegainfer-project/pegainfer

Rank 43: vllm-project/vllm

Rank 669: LMCache/LMCache

Rank 851: xorbitsai/inference

Rank 1,372: lemonade-sdk/lemonade

Support Us