Rank #7,564 724 starsRust

pegainfer

by pegainfer-project (organization)

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2 (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 724
Forks: 117
Open issues and pull requests: 76
Primary language: Rust
License: Apache License 2.0 (Apache-2.0)
Owner: pegainfer-project · Organization
Created: Feb 17, 2026
Last push: Oct 17, 2026

Topics

Rank #7,564 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #7,564 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #7,564 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/pegainfer-project--pegainfer.svg)](https://unitedstatesofamericasuperintelligence.com/github/pegainfer-project--pegainfer/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/pegainfer-project--pegainfer/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/pegainfer-project--pegainfer.svg" alt="Ranked #7,564 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 3,852: SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
1,874 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026
Rank 9,341: ome-projects/ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
517 starsGoApache-2.0Last push Oct 18, 2026
Rank 3,585: syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/…
2,054 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 43: vllm-project/vllm

Rank 3,852: SemiAnalysisAI/InferenceX

Rank 1,389: gpustack/gpustack

Rank 9,341: ome-projects/ome

Rank 3,585: syv-ai/HyperQwen

Rank 7,888: ARahim3/kaggle-tpu-lab

Support Us