
sonar
by dphnAI (organization)
Large-scale LLM inference engine (description from the project’s GitHub page)
Repository facts
- Stars
- 1,877
- Forks
- 211
- Open issues and pull requests
- 55
- Primary language
- Python
- License
- GNU Affero General Public License v3.0 (AGPL-3.0)
- Owner
- dphnAI · Organization
- Created
- Jun 23, 2023
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/dphnai--sonar/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/dphnai--sonar/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/dphnai--sonar.svg" alt="Ranked #3,844 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,051: peonist-ai/halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
1,018 starsShellOther licenseLast push Oct 18, 2026
Rank 2,698: Luce-Org/lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
2,928 starsC++Apache-2.0Last push Oct 18, 2026
Rank 3,720: siliconflow/onediff
OneDiff: An out-of-the-box acceleration library for diffusion models.
1,962 starsJupyter NotebookApache-2.0Last push Dec 4, 2025
Rank 6,725: insight-platform/Savant
Python Computer Vision & Video Analytics Framework With Batteries Included
863 starsPythonApache-2.0Last push Sep 23, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026
Rank 500: tracel-ai/burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
16,127 starsRustApache-2.0Last push Oct 16, 2026