Rank #3,232 2,336 starsPython

mixtral-offloading

by dvmazur (personal account)

Run Mixtral-8x7B models in Colab or consumer desktops (description from the project’s GitHub page)

Repository facts

Stars: 2,336
Forks: 225
Open issues and pull requests: 26
Primary language: Python
License: MIT License (MIT)
Owner: dvmazur · Personal account
Created: Dec 15, 2023
Last push: Apr 8, 2024

Topics

Rank #3,232 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #3,232 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #3,232 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/dvmazur--mixtral-offloading.svg)](https://unitedstatesofamericasuperintelligence.com/github/dvmazur--mixtral-offloading/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/dvmazur--mixtral-offloading/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/dvmazur--mixtral-offloading.svg" alt="Ranked #3,232 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 4,025: tugstugi/dl-colab-notebooks
Try out deep learning models online on Google Colab
1,776 starsJupyter NotebookNo license file detectedLast push Mar 10, 2022
Rank 4,309: yoshitomo-matsubara/torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurI…
1,634 starsPythonMITLast push Oct 12, 2026
Rank 2,899: stochasticai/xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: ht…
2,674 starsPythonApache-2.0Last push Oct 18, 2026
Rank 908: FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
9,094 starsCApache-2.0Last push Oct 2, 2026
Rank 4,406: RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
1,587 starsC++MITLast push Mar 23, 2025
Rank 4,827: RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
1,400 starsJavaScriptNo license file detectedLast push Dec 3, 2024

Repository facts

Topics

Add this badge to your README

Related projects

Rank 4,025: tugstugi/dl-colab-notebooks

Rank 4,309: yoshitomo-matsubara/torchdistill

Rank 2,899: stochasticai/xTuring

Rank 908: FareedKhan-dev/kimi-k3-in-c

Rank 4,406: RWKV/rwkv.cpp

Rank 4,827: RahulSChand/gpu_poor

Support Us