
LiteRT-LM
by google-ai-edge (organization)
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices. (description from the project’s GitHub page)
Repository facts
- Stars
- 6,691
- Forks
- 758
- Open issues and pull requests
- 712
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- google-ai-edge · Organization
- Created
- Apr 14, 2025
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/google-ai-edge--litert-lm/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/google-ai-edge--litert-lm/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/google-ai-edge--litert-lm.svg" alt="Ranked #1,208 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 1,169: drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
6,943 starsSwiftApache-2.0Last push Oct 15, 2026
Rank 1,326: cactus-compute/cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
6,128 starsC++Other licenseLast push Sep 26, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026
Rank 583: cactus-compute/needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontro…
14,078 starsPythonApache-2.0Last push Oct 17, 2026
Rank 3,976: cosmo-wander-ai/cosmo-edge
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible…
1,802 starsCApache-2.0Last push Oct 16, 2026