HyperQwen
by syv-ai (organization)
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks. (description from the project’s GitHub page)
Repository facts
- Stars
- 2,054
- Forks
- 281
- Open issues and pull requests
- 4
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- syv-ai · Organization
- Created
- Aug 15, 2026
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/syv-ai--hyperqwen/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/syv-ai--hyperqwen/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/syv-ai--hyperqwen.svg" alt="Ranked #3,585 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026
Rank 2,959: youssofal/MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…
2,598 starsPythonApache-2.0Last push Oct 10, 2026
Rank 5,991: StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
1,033 starsPythonMITLast push Oct 13, 2026
Rank 6,051: peonist-ai/halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
1,018 starsShellOther licenseLast push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026