
ServerlessLLM
by ServerlessLLM (organization)
Serverless LLM Serving for Everyone. (description from the project’s GitHub page)
Repository facts
- Stars
- 718
- Forks
- 78
- Open issues and pull requests
- 46
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- ServerlessLLM · Organization
- Created
- Jan 23, 2024
- Last push
- Sep 4, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/serverlessllm--serverlessllm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/serverlessllm--serverlessllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/serverlessllm--serverlessllm.svg" alt="Ranked #7,611 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 9,341: ome-projects/ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
517 starsGoApache-2.0Last push Oct 18, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,512: sgl-project/sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
1,543 starsPythonApache-2.0Last push Oct 18, 2026
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026
Rank 1,323: amazon-science/chronos-forecasting
Chronos: Pretrained Models for Time Series Forecasting
6,135 starsPythonApache-2.0Last push Oct 5, 2026
Rank 3,236: refuel-ai/autolabel
Label, clean and enrich text datasets with LLMs.
2,330 starsPythonMITLast push Mar 5, 2025