
OpenLLM
by bentoml (organization)
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud. (description from the project’s GitHub page)
Repository facts
- Stars
- 12,559
- Forks
- 947
- Open issues and pull requests
- 21
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- bentoml · Organization
- Created
- Apr 19, 2023
- Last push
- Oct 12, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/bentoml--openllm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/bentoml--openllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/bentoml--openllm.svg" alt="Ranked #645 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 8,747: rohan-paul/LLM-FineTuning-Large-Language-Models
LLM (Large Language Model) FineTuning
578 starsJupyter NotebookNo license file detectedLast push Apr 1, 2025
Rank 9,121: kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
539 starsGoMITLast push Oct 12, 2026
Rank 922: bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
8,906 starsPythonApache-2.0Last push Oct 5, 2026
Rank 685: ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
11,774 starsPythonApache-2.0Last push Oct 12, 2026
Rank 1,506: superduper-io/superduper
Superduper: End-to-end framework for building custom AI applications and agents.
5,325 starsPythonApache-2.0Last push Sep 1, 2025
Rank 3,107: AI-Hypercomputer/maxtext
A simple, performant, and scalable Jax LLM!
2,445 starsPythonApache-2.0Last push Oct 18, 2026