model_server
by openvinotoolkit (organization)
A scalable inference server for models optimized with OpenVINO™ (description from the project’s GitHub page)
Repository facts
- Stars
- 950
- Forks
- 283
- Open issues and pull requests
- 157
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- openvinotoolkit · Organization
- Created
- Sep 26, 2018
- Last push
- Oct 16, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/openvinotoolkit--model-server/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/openvinotoolkit--model-server/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/openvinotoolkit--model-server.svg" alt="Ranked #6,312 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 9,107: underneathall/pinferencia
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
541 starsPythonApache-2.0Last push Feb 14, 2023
Rank 729: triton-inference-server/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
11,095 starsPythonBSD-3-ClauseLast push Oct 16, 2026
Rank 1,327: kserve/kserve
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
6,128 starsGoApache-2.0Last push Oct 17, 2026
Rank 3,293: dstackai/dstack
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clus…
2,284 starsPythonMPL-2.0Last push Oct 17, 2026
Rank 3,828: nndeploy/nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
1,886 starsC++Apache-2.0Last push Aug 15, 2026
Rank 736: openvinotoolkit/openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
11,018 starsC++Apache-2.0Last push Oct 17, 2026