Rank #1,199 6,758 starsPython

LLMLingua

by microsoft (organization)

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss. (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 6,758
Forks: 440
Open issues and pull requests: 125
Primary language: Python
License: MIT License (MIT)
Owner: microsoft · Organization
Created: Jul 7, 2023
Last push: Sep 10, 2026

Rank #1,199 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #1,199 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #1,199 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/microsoft--llmlingua.svg)](https://unitedstatesofamericasuperintelligence.com/github/microsoft--llmlingua/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/microsoft--llmlingua/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/microsoft--llmlingua.svg" alt="Ranked #1,199 in AI on GitHub" height="20"></a>

Repository facts

Add this badge to your README

Support Us