Rank #3,652 1,999 starsPython

knowledge-distillation-pytorch

by haitongli (personal account)

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 1,999
Forks: 350
Open issues and pull requests: 20
Primary language: Python
License: MIT License (MIT)
Owner: haitongli · Personal account
Created: Mar 9, 2018
Last push: Mar 25, 2023

Topics

Rank #3,652 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #3,652 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #3,652 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/haitongli--knowledge-distillation-pytorch.svg)](https://unitedstatesofamericasuperintelligence.com/github/haitongli--knowledge-distillation-pytorch/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/haitongli--knowledge-distillation-pytorch/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/haitongli--knowledge-distillation-pytorch.svg" alt="Ranked #3,652 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 6,276: MingSun-Tse/Efficient-Deep-Learning
Collection of recent methods on (deep) neural network compression and acceleration.
959 starsMITLast push Apr 4, 2025
Rank 4,309: yoshitomo-matsubara/torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurI…
1,634 starsPythonMITLast push Oct 12, 2026
Rank 4,673: microsoft/NeuronBlocks
NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego
1,456 starsPythonMITLast push Jul 22, 2023
Rank 7,758: huyvnphan/PyTorch_CIFAR10
Pretrained TorchVision models on CIFAR10 dataset (with weights)
697 starsPythonMITLast push Jun 24, 2023
Rank 6,633: alibaba/TinyNeuralNetwork
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
880 starsPythonMITLast push Mar 3, 2026
Rank 6,540: megvii-research/mdistiller
The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.…
899 starsPythonNo license file detectedLast push Nov 5, 2023

Repository facts

Topics

Add this badge to your README

Related projects

Rank 6,276: MingSun-Tse/Efficient-Deep-Learning

Rank 4,309: yoshitomo-matsubara/torchdistill

Rank 4,673: microsoft/NeuronBlocks

Rank 7,758: huyvnphan/PyTorch_CIFAR10

Rank 6,633: alibaba/TinyNeuralNetwork

Rank 6,540: megvii-research/mdistiller

Support Us