Rank #7,382 752 starsC++

InferLLM

by MegEngine (organization)

a lightweight LLM model inference framework (description from the project’s GitHub page)

Repository facts

Stars: 752
Forks: 94
Open issues and pull requests: 41
Primary language: C++
License: Apache License 2.0 (Apache-2.0)
Owner: MegEngine · Organization
Created: May 4, 2023
Last push: Apr 7, 2024

Topics

Rank #7,382 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #7,382 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #7,382 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/megengine--inferllm.svg)](https://unitedstatesofamericasuperintelligence.com/github/megengine--inferllm/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/megengine--inferllm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/megengine--inferllm.svg" alt="Ranked #7,382 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 6,292: huawei-noah/bolt
Bolt is a deep learning library with high performance and heterogeneous flexibility.
955 starsC++MITLast push Apr 11, 2025
Rank 6,347: uber/neuropod
A uniform interface to run deep learning models from multiple frameworks
942 starsC++Apache-2.0Last push Jan 3, 2024
Rank 5,302: qualcomm/ai-hub-models
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
1,229 starsPythonBSD-3-ClauseLast push Oct 17, 2026
Rank 7,497: onepanelio/onepanel
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
733 starsGoApache-2.0Last push Feb 25, 2023
Rank 1,326: cactus-compute/cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
6,128 starsC++Other licenseLast push Sep 26, 2026
Rank 4,324: UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1,628 starsC++MITLast push Sep 30, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 6,292: huawei-noah/bolt

Rank 6,347: uber/neuropod

Rank 5,302: qualcomm/ai-hub-models

Rank 7,497: onepanelio/onepanel

Rank 1,326: cactus-compute/cactus

Rank 4,324: UbiquitousLearning/mllm

Support Us