Rank #6,233 968 starsC++

TinyChatEngine

by mit-han-lab (organization)

TinyChatEngine: On-Device LLM Inference Library (description from the project’s GitHub page)

Repository facts

Stars: 968
Forks: 102
Open issues and pull requests: 41
Primary language: C++
License: MIT License (MIT)
Owner: mit-han-lab · Organization
Created: May 24, 2023
Last push: Jul 4, 2024

Topics

Rank #6,233 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,233 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,233 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/mit-han-lab--tinychatengine.svg)](https://unitedstatesofamericasuperintelligence.com/github/mit-han-lab--tinychatengine/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/mit-han-lab--tinychatengine/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/mit-han-lab--tinychatengine.svg" alt="Ranked #6,233 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 6,238: mit-han-lab/tinyengine
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Devic…
967 starsCMITLast push Nov 27, 2024
Rank 1,946: uxlfoundation/oneDNN
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, a…
4,067 starsC++Apache-2.0Last push Oct 18, 2026
Rank 8,807: Maknee/minigpt4.cpp
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
572 starsC++MITLast push Aug 8, 2023
Rank 1,768: OAID/Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
4,533 starsC++Apache-2.0Last push Mar 6, 2025
Rank 4,188: microsoft/EdgeML
This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.
1,691 starsC++Other licenseLast push May 20, 2024
Rank 5,643: Dobiasd/frugally-deep
A lightweight header-only library for using Keras (TensorFlow) models in C++.
1,128 starsC++MITLast push May 6, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 6,238: mit-han-lab/tinyengine

Rank 1,946: uxlfoundation/oneDNN

Rank 8,807: Maknee/minigpt4.cpp

Rank 1,768: OAID/Tengine

Rank 4,188: microsoft/EdgeML

Rank 5,643: Dobiasd/frugally-deep

Support Us