
GPTQModel
by ModelCloud (organization)
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,274
- Forks
- 211
- Open issues and pull requests
- 31
- Primary language
- Python
- License
- Other license
- Owner
- ModelCloud · Organization
- Created
- Jun 17, 2024
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/modelcloud--gptqmodel/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/modelcloud--gptqmodel/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/modelcloud--gptqmodel.svg" alt="Ranked #5,162 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,932: whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
825 starsPythonOther licenseLast push Oct 15, 2026
Rank 4,252: intel/auto-round
PTQ-Level Efficiency, QAT-Level Accuracy|训练后量化的效率,量化感知训练的精度
1,661 starsPythonApache-2.0Last push Oct 18, 2026
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 2,853: intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
2,722 starsPythonApache-2.0Last push Oct 16, 2026
Rank 5,911: huggingface/optimum-quanto
A pytorch quantization backend for optimum
1,053 starsPythonApache-2.0Last push Oct 14, 2026