Rank #1,362 5,982 starsRust

shimmy

by Michael-A-Kuykendall (personal account)

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary. (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 5,982
Forks: 586
Open issues and pull requests: 13
Primary language: Rust
License: Apache License 2.0 (Apache-2.0)
Owner: Michael-A-Kuykendall · Personal account
Created: Aug 28, 2025
Last push: Aug 30, 2026

Topics

Rank #1,362 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #1,362 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #1,362 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/michael-a-kuykendall--shimmy.svg)](https://unitedstatesofamericasuperintelligence.com/github/michael-a-kuykendall--shimmy/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/michael-a-kuykendall--shimmy/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/michael-a-kuykendall--shimmy.svg" alt="Ranked #1,362 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 6,966: mukel/llama3.java
Llama 3+ inference in pure Java
820 starsJavaMITLast push Apr 24, 2026
Rank 890: MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
9,314 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,979: raullenchai/Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
3,996 starsPythonOther licenseLast push Oct 18, 2026
Rank 3,960: AtomicBot-ai/Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
1,810 starsTypeScriptOther licenseLast push Oct 17, 2026
Rank 7,760: tetherto/qvac
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-plat…
697 starsTypeScriptApache-2.0Last push Oct 18, 2026
Rank 9,193: automataIA/graphrag-rs
GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and en…
532 starsRustMITLast push Jun 2, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 6,966: mukel/llama3.java

Rank 890: MakazhanAlpamys/Soup

Rank 1,979: raullenchai/Rapid-MLX

Rank 3,960: AtomicBot-ai/Atomic-Chat

Rank 7,760: tetherto/qvac

Rank 9,193: automataIA/graphrag-rs

Support Us