
Tutel
by microsoft (organization)
Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4 (description from the project’s GitHub page)
Repository facts
- Stars
- 1,028
- Forks
- 111
- Open issues and pull requests
- 55
- Primary language
- C
- License
- MIT License (MIT)
- Owner
- microsoft · Organization
- Created
- Aug 6, 2021
- Last push
- Oct 4, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/microsoft--tutel/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/microsoft--tutel/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/microsoft--tutel.svg" alt="Ranked #6,008 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 908: FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
9,094 starsCApache-2.0Last push Oct 2, 2026
Rank 5,217: davidmrau/mixture-of-experts
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
1,256 starsPythonGPL-3.0Last push Apr 19, 2024
Rank 6,027: mw00/project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…
1,023 starsC++MITLast push Oct 16, 2026
Rank 6,099: pjlab-sys4nlp/llama-moe
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
1,005 starsPythonApache-2.0Last push Dec 6, 2024
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026