
paddler
by intentee (organization)
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,679
- Forks
- 110
- Open issues and pull requests
- 30
- Primary language
- Rust
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- intentee · Organization
- Created
- Apr 27, 2024
- Last push
- Oct 15, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/intentee--paddler/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/intentee--paddler/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/intentee--paddler.svg" alt="Ranked #4,214 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,442: Josh-XT/AGiXT
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memo…
3,216 starsPythonMITLast push Jul 28, 2026
Rank 8,229: Fast-Editor/Lynkr
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
633 starsJavaScriptApache-2.0Last push Oct 13, 2026
Rank 1,139: tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号…
7,147 starsGoMITLast push Oct 18, 2026
Rank 2,450: SilasMarvin/lsp-ai
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
3,210 starsRustMITLast push Jan 7, 2025
Rank 3,363: floneum/kalosm
Instant, controllable, local pre-trained AI models in Rust
2,226 starsRustApache-2.0Last push Oct 18, 2026
Rank 6,626: huggingface/llm-ls
LSP server leveraging LLMs for code completion (and more?)
881 starsRustApache-2.0Last push Sep 23, 2026