Rank #1,732 4,638 starsPython

exllamav2

by turboderp-org (organization)

A fast inference library for running LLMs locally on modern consumer-class GPUs (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 4,638
Forks: 347
Open issues and pull requests: 162
Primary language: Python
License: MIT License (MIT)
Owner: turboderp-org · Organization
Created: Aug 30, 2023
Last push: Mar 4, 2026

Rank #1,732 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #1,732 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #1,732 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/turboderp-org--exllamav2.svg)](https://unitedstatesofamericasuperintelligence.com/github/turboderp-org--exllamav2/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/turboderp-org--exllamav2/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/turboderp-org--exllamav2.svg" alt="Ranked #1,732 in AI on GitHub" height="20"></a>

Repository facts

Add this badge to your README

Support Us