llm-compressor
by vllm-project (organization)
State-of-the-art LLM compression, built for production inference with vLLM (description from the project’s GitHub page)
Repository facts
- Stars
- 3,884
- Forks
- 697
- Open issues and pull requests
- 115
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- vllm-project · Organization
- Created
- Jun 20, 2024
- Last push
- Oct 17, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/vllm-project--llm-compressor/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/vllm-project--llm-compressor/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/vllm-project--llm-compressor.svg" alt="Ranked #2,035 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,845: qualcomm/aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
2,729 starsPythonOther licenseLast push Oct 17, 2026
Rank 4,428: tensorflow/model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
1,580 starsPythonApache-2.0Last push Oct 14, 2026
Rank 5,380: openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
1,209 starsPythonApache-2.0Last push Oct 14, 2026
Rank 63: headroomlabs-ai/headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP s…
75,783 starsPythonApache-2.0Last push Oct 17, 2026
Rank 141: deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
43,242 starsPythonApache-2.0Last push Oct 18, 2026
Rank 624: PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
12,977 starsPythonApache-2.0Last push May 23, 2026