Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated green constellation network artwork for waybarrios/vllm-mlx, labeled USASI · AI on GitHub, with Personal account · Python · Apache-2.0.
Rank #4,327 1,626 starsPython

vllm-mlx

by waybarrios (personal account)

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support. (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: vllm-mlx.is-a.dev)

Repository facts

Stars
1,626
Forks
241
Open issues and pull requests
104
Primary language
Python
License
Apache License 2.0 (Apache-2.0)
Owner
waybarrios · Personal account
Created
Dec 6, 2025
Last push
Oct 16, 2026

Topics

Rank #4,327 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #4,327 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #4,327 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/waybarrios--vllm-mlx.svg)](https://unitedstatesofamericasuperintelligence.com/github/waybarrios--vllm-mlx/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/waybarrios--vllm-mlx/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/waybarrios--vllm-mlx.svg" alt="Ranked #4,327 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 1,979: raullenchai/Rapid-MLX

    Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…

    3,996 starsPythonOther licenseLast push Oct 18, 2026

  • Rank 3,695: ddalcu/mlx-serve

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    1,977 starsZigOther licenseLast push Oct 18, 2026

  • Rank 4,701: ARahim3/mlx-tune

    Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

    1,444 starsPythonApache-2.0Last push Jun 23, 2026

  • Rank 2,959: youssofal/MTPLX

    The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…

    2,598 starsPythonApache-2.0Last push Oct 10, 2026

  • Rank 2,336: nicedreamzapp/claude-code-local

    Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gem…

    3,369 starsPythonMITLast push Oct 15, 2026

  • Rank 359: jundot/omlx

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    22,905 starsPythonApache-2.0Last push Oct 17, 2026

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project