Rank #6,099 1,005 starsPython

llama-moe

by pjlab-sys4nlp (organization)

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024) (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 1,005
Forks: 60
Open issues and pull requests: 7
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: pjlab-sys4nlp · Organization
Created: Jul 24, 2023
Last push: Dec 6, 2024

Topics

Rank #6,099 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,099 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,099 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/pjlab-sys4nlp--llama-moe.svg)](https://unitedstatesofamericasuperintelligence.com/github/pjlab-sys4nlp--llama-moe/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/pjlab-sys4nlp--llama-moe/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/pjlab-sys4nlp--llama-moe.svg" alt="Ranked #6,099 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 8,395: ymcui/Chinese-Mixtral
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
613 starsPythonApache-2.0Last push Apr 19, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 513: modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…
15,871 starsPythonApache-2.0Last push Oct 18, 2026
Rank 908: FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
9,094 starsCApache-2.0Last push Oct 2, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 8,395: ymcui/Chinese-Mixtral

Rank 43: vllm-project/vllm

Rank 64: hiyouga/LlamaFactory

Rank 185: sgl-project/sglang

Rank 513: modelscope/ms-swift

Rank 908: FareedKhan-dev/kimi-k3-in-c

Support Us