
Model-Optimizer
by NVIDIA (organization)
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed. (description from the project’s GitHub page)
Repository facts
- Stars
- 5,356
- Forks
- 752
- Open issues and pull requests
- 501
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NVIDIA · Organization
- Created
- Apr 23, 2024
- Last push
- Oct 18, 2026
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/nvidia--model-optimizer/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/nvidia--model-optimizer/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/nvidia--model-optimizer.svg" alt="Ranked #1,499 in AI on GitHub" height="20"></a>