kvpress
by NVIDIA (organization)
LLM KV cache compression made easy (description from the project’s GitHub page)
Repository facts
- Stars
- 1,233
- Forks
- 190
- Open issues and pull requests
- 12
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NVIDIA · Organization
- Created
- Nov 6, 2024
- Last push
- Oct 6, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/nvidia--kvpress/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/nvidia--kvpress/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/nvidia--kvpress.svg" alt="Ranked #5,292 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 7,239: haoliuhl/ringattention
Large Context Attention
774 starsPythonApache-2.0Last push Oct 13, 2025
Rank 669: LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
12,108 starsPythonApache-2.0Last push Oct 18, 2026
Rank 851: xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…
9,616 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,506: superduper-io/superduper
Superduper: End-to-end framework for building custom AI applications and agents.
5,325 starsPythonApache-2.0Last push Sep 1, 2025
Rank 9,107: underneathall/pinferencia
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
541 starsPythonApache-2.0Last push Feb 14, 2023
Rank 618: neuml/txtai
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
13,024 starsPythonApache-2.0Last push Oct 16, 2026