vllm-metal
by vllm-project (organization)
Community maintained hardware plugin for vLLM on Apple Silicon (description from the project’s GitHub page)
Repository facts
- Stars
- 1,886
- Forks
- 330
- Open issues and pull requests
- 41
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- vllm-project · Organization
- Created
- Dec 12, 2025
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/vllm-project--vllm-metal/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/vllm-project--vllm-metal/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/vllm-project--vllm-metal.svg" alt="Ranked #3,829 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 2,959: youssofal/MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…
2,598 starsPythonApache-2.0Last push Oct 10, 2026
Rank 7,596: ARahim3/mlx-dspark
Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM…
719 starsPythonMITLast push Oct 5, 2026
Rank 359: jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
22,905 starsPythonApache-2.0Last push Oct 17, 2026
Rank 4,701: ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1,444 starsPythonApache-2.0Last push Jun 23, 2026
Rank 1,169: drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
6,943 starsSwiftApache-2.0Last push Oct 15, 2026