Rank #7,427 745 starsPython

mlx-omni-server

by madroidmaq (personal account)

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference. (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 745
Forks: 88
Open issues and pull requests: 25
Primary language: Python
License: MIT License (MIT)
Owner: madroidmaq · Personal account
Created: Nov 5, 2024
Last push: May 9, 2026

Topics

Rank #7,427 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #7,427 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #7,427 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/madroidmaq--mlx-omni-server.svg)](https://unitedstatesofamericasuperintelligence.com/github/madroidmaq--mlx-omni-server/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/madroidmaq--mlx-omni-server/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/madroidmaq--mlx-omni-server.svg" alt="Ranked #7,427 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 7,914: teilomillet/gollm
Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.
676 starsGoApache-2.0Last push Mar 21, 2026
Rank 7,009: KoljaB/Linguflex
Command Your World with Voice
813 starsPythonNo license file detectedLast push Jun 17, 2025
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 7,070: Blaizzy/mlx-audio-swift
A modular Swift SDK for audio processing with MLX on Apple Silicon
802 starsSwiftMITLast push Oct 10, 2026
Rank 1,851: algorithmicsuperintelligence/optillm
Optimizing inference proxy for LLMs
4,319 starsPythonApache-2.0Last push Oct 11, 2026
Rank 7,815: travisvn/chatterbox-tts-api
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, e…
690 starsPythonAGPL-3.0Last push Dec 23, 2025

Repository facts

Topics

Add this badge to your README

Related projects

Rank 7,914: teilomillet/gollm

Rank 7,009: KoljaB/Linguflex

Rank 4,327: waybarrios/vllm-mlx

Rank 7,070: Blaizzy/mlx-audio-swift

Rank 1,851: algorithmicsuperintelligence/optillm

Rank 7,815: travisvn/chatterbox-tts-api

Support Us