
OlliteRT
by NightMean (personal account)
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source (description from the project’s GitHub page)
Repository facts
- Stars
- 569
- Forks
- 81
- Open issues and pull requests
- 15
- Primary language
- Kotlin
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NightMean · Personal account
- Created
- Apr 6, 2026
- Last push
- Oct 8, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/nightmean--ollitert/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/nightmean--ollitert/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/nightmean--ollitert.svg" alt="Ranked #8,842 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,424: jegly/Box
The most advanced, fully offline client-side AI suite on Android today.
921 starsKotlinOther licenseLast push Oct 18, 2026
Rank 3,551: fikrikarim/parlor
On-device, real-time multimodal AI with features similar to GPT-Live
2,076 starsPythonApache-2.0Last push Aug 3, 2026
Rank 8,162: DenisovAV/flutter_edge_ai
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
641 starsDartMITLast push Oct 18, 2026
Rank 5,734: agents-io/PokeClaw
PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.
1,100 starsKotlinApache-2.0Last push Jun 2, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026