Rank #359 22,905 starsPython

omlx

by jundot (personal account)

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 22,905
Forks: 2,136
Open issues and pull requests: 651
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: jundot · Personal account
Created: Feb 13, 2026
Last push: Oct 17, 2026

Topics

Rank #359 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #359 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #359 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/jundot--omlx.svg)](https://unitedstatesofamericasuperintelligence.com/github/jundot--omlx/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/jundot--omlx/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/jundot--omlx.svg" alt="Ranked #359 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 1,979: raullenchai/Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
3,996 starsPythonOther licenseLast push Oct 18, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 3,829: vllm-project/vllm-metal
Community maintained hardware plugin for vLLM on Apple Silicon
1,886 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,701: ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1,444 starsPythonApache-2.0Last push Jun 23, 2026
Rank 6,168: jjang-ai/mlxstudio
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
986 starsNo license file detectedLast push Oct 14, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 4,327: waybarrios/vllm-mlx

Rank 1,979: raullenchai/Rapid-MLX

Rank 3,695: ddalcu/mlx-serve

Rank 3,829: vllm-project/vllm-metal

Rank 4,701: ARahim3/mlx-tune

Rank 6,168: jjang-ai/mlxstudio

Support Us