
semantic-router
by vllm-project (organization)
An open, programmable decision layer for models and compute. (description from the project’s GitHub page)
Repository facts
- Stars
- 6,206
- Forks
- 1,055
- Open issues and pull requests
- 615
- Primary language
- Go
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- vllm-project · Organization
- Created
- Aug 26, 2025
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/vllm-project--semantic-router/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/vllm-project--semantic-router/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/vllm-project--semantic-router.svg" alt="Ranked #1,308 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 3,348: theagentrouter/agent-router
Manages Unified Access to Generative AI Services built on Envoy Gateway
2,240 starsGoApache-2.0Last push Oct 16, 2026
Rank 4,191: theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
1,690 starsTypeScriptOther licenseLast push Oct 18, 2026
Rank 2,619: vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2,996 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,753: microsoft/vidur
Accurate, large-scale, and extensible simulator for LLM inference Systems
698 starsPythonMITLast push Aug 24, 2026
Rank 669: LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
12,108 starsPythonApache-2.0Last push Oct 18, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026