
lucebox
by Luce-Org (organization)
LLM speculative inference server for heterogeneous hardware & consumer GPUs (description from the project’s GitHub page)
Repository facts
- Stars
- 2,928
- Forks
- 286
- Open issues and pull requests
- 101
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Luce-Org · Organization
- Created
- Apr 3, 2026
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/luce-org--lucebox/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/luce-org--lucebox/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/luce-org--lucebox.svg" alt="Ranked #2,698 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,051: peonist-ai/halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
1,018 starsShellOther licenseLast push Oct 18, 2026
Rank 4,053: Tencent/AngelSlim
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
1,762 starsPythonOther licenseLast push Oct 14, 2026
Rank 1,074: Osmantic/ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
7,571 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 3,844: dphnAI/sonar
Large-scale LLM inference engine
1,877 starsPythonAGPL-3.0Last push Oct 18, 2026
Rank 5,991: StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
1,033 starsPythonMITLast push Oct 13, 2026