rkllama
by NotPunchnox (personal account)
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm ) (description from the project’s GitHub page)
Repository facts
- Stars
- 616
- Forks
- 102
- Open issues and pull requests
- 69
- Primary language
- Python
- License
- GNU General Public License v3.0 (GPL-3.0)
- Owner
- NotPunchnox · Personal account
- Created
- Dec 30, 2024
- Last push
- Aug 25, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/notpunchnox--rkllama/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/notpunchnox--rkllama/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/notpunchnox--rkllama.svg" alt="Ranked #8,365 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 3,976: cosmo-wander-ai/cosmo-edge
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible…
1,802 starsCApache-2.0Last push Oct 16, 2026
Rank 8,868: jaylfc/taOS
Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framewor…
566 starsPythonAGPL-3.0Last push Oct 18, 2026
Rank 1,372: lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
5,927 starsC++Apache-2.0Last push Oct 18, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 1,796: gptme/gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
4,456 starsPythonMITLast push Oct 18, 2026
Rank 7,333: raiyanyahya/recall
Stop wasting tokens and re-explaining your project every session. Recall gives Claude Code , Opencode durable memory — entirely offline.
759 starsPythonMITLast push Sep 7, 2026