
LitServe
by Lightning-AI (organization)
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. (description from the project’s GitHub page)
Repository facts
- Stars
- 3,955
- Forks
- 318
- Open issues and pull requests
- 65
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Lightning-AI · Organization
- Created
- Dec 12, 2023
- Last push
- Oct 14, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/lightning-ai--litserve/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/lightning-ai--litserve/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/lightning-ai--litserve.svg" alt="Ranked #2,002 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,348: msoedov/langcorn
⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
941 starsPythonMITLast push Jul 15, 2024
Rank 3,518: Anil-matcha/open-agent-email
Open-source email infrastructure for AI agents: secure inboxes, REST and MCP APIs, SMTP, human approval workflows, signed webhooks, and Python and TypeScript SDKs. Self-host with…
2,100 starsPythonApache-2.0Last push Oct 16, 2026
Rank 5,298: bricks-cloud/BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environ…
1,230 starsGoMITLast push Jan 5, 2025
Rank 6,331: Pipelex/pipelex
Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.
946 starsPythonOther licenseLast push Oct 18, 2026
Rank 1,396: Klavis-AI/klavis
Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale
5,814 starsPythonApache-2.0Last push Jun 1, 2026