Pretrained-Language-Model
by huawei-noah (organization)
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab. (description from the project’s GitHub page)
Repository facts
- Stars
- 3,166
- Forks
- 638
- Open issues and pull requests
- 109
- Primary language
- Python
- License
- No license file detected
- Owner
- huawei-noah · Organization
- Created
- Dec 2, 2019
- Last push
- Jan 22, 2024
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/huawei-noah--pretrained-language-model/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/huawei-noah--pretrained-language-model/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/huawei-noah--pretrained-language-model.svg" alt="Ranked #2,484 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 3,652: haitongli/knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
1,999 starsPythonMITLast push Mar 25, 2023
Rank 4,673: microsoft/NeuronBlocks
NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego
1,456 starsPythonMITLast push Jul 22, 2023
Rank 3,322: 666DZY666/micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for…
2,262 starsPythonMITLast push May 6, 2025
Rank 4,428: tensorflow/model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
1,580 starsPythonApache-2.0Last push Oct 14, 2026
Rank 7,567: SqueezeAILab/SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
724 starsPythonMITLast push Aug 13, 2024
Rank 1,811: huawei-noah/Efficient-AI-Backbones
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
4,424 starsPythonNo license file detectedLast push Mar 15, 2025