Rank #6,963 820 starsJupyter Notebook

makeMoE

by AviSoori1x (personal account)

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :) (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 820
Forks: 96
Open issues and pull requests: 4
Primary language: Jupyter Notebook
License: MIT License (MIT)
Owner: AviSoori1x · Personal account
Created: Jan 22, 2024
Last push: Oct 30, 2024

Topics

Rank #6,963 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,963 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,963 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/avisoori1x--makemoe.svg)](https://unitedstatesofamericasuperintelligence.com/github/avisoori1x--makemoe/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/avisoori1x--makemoe/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/avisoori1x--makemoe.svg" alt="Ranked #6,963 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 3,017: learning-at-home/hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
2,541 starsPythonMITLast push Jan 11, 2026
Rank 2,126: christianversloot/machine-learning-articles
🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
3,699 starsNo license file detectedLast push Jun 28, 2024
Rank 768: bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10,639 starsPythonMITLast push Sep 7, 2024
Rank 1,851: algorithmicsuperintelligence/optillm
Optimizing inference proxy for LLMs
4,319 starsPythonApache-2.0Last push Oct 11, 2026
Rank 8,395: ymcui/Chinese-Mixtral
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
613 starsPythonApache-2.0Last push Apr 19, 2026
Rank 9,362: Leeroo-AI/mergoo
A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
515 starsPythonLGPL-3.0Last push Aug 26, 2024

Repository facts

Topics

Add this badge to your README

Related projects

Rank 3,017: learning-at-home/hivemind

Rank 2,126: christianversloot/machine-learning-articles

Rank 768: bigscience-workshop/petals

Rank 1,851: algorithmicsuperintelligence/optillm

Rank 8,395: ymcui/Chinese-Mixtral

Rank 9,362: Leeroo-AI/mergoo

Support Us