BigMoeOnEdge
by Helldez (personal account)
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp (description from the project’s GitHub page)
Repository facts
- Stars
- 631
- Forks
- 81
- Open issues and pull requests
- 27
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Helldez · Personal account
- Created
- Jul 10, 2026
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/helldez--bigmoeonedge/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/helldez--bigmoeonedge/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/helldez--bigmoeonedge.svg" alt="Ranked #8,244 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 3,960: AtomicBot-ai/Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
1,810 starsTypeScriptOther licenseLast push Oct 17, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 882: oumi-ai/oumi
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
9,403 starsPythonApache-2.0Last push Oct 15, 2026
Rank 787: RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
10,330 starsC++Other licenseLast push Oct 18, 2026