BentoML
by bentoml (organization)
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more! (description from the project’s GitHub page)
Repository facts
- Stars
- 8,906
- Forks
- 1,045
- Open issues and pull requests
- 235
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- bentoml · Organization
- Created
- Apr 2, 2019
- Last push
- Oct 5, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/bentoml--bentoml/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/bentoml--bentoml/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/bentoml--bentoml.svg" alt="Ranked #922 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 376: jina-ai/serve
☁️ Build multimodal AI applications with cloud-native stack
21,854 starsPythonApache-2.0Last push Mar 24, 2025
Rank 2,619: vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2,996 starsPythonApache-2.0Last push Oct 18, 2026
Rank 645: bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
12,559 starsPythonApache-2.0Last push Oct 12, 2026
Rank 1,506: superduper-io/superduper
Superduper: End-to-end framework for building custom AI applications and agents.
5,325 starsPythonApache-2.0Last push Sep 1, 2025
Rank 6,523: mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
902 starsPythonApache-2.0Last push Oct 12, 2026