Rank #2,528 3,112 starsC++

distributed-llama

by b4rtaz (personal account)

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference. (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 3,112
Forks: 265
Open issues and pull requests: 48
Primary language: C++
License: MIT License (MIT)
Owner: b4rtaz · Personal account
Created: Dec 4, 2023
Last push: Oct 14, 2026

Topics

Rank #2,528 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #2,528 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #2,528 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/b4rtaz--distributed-llama.svg)](https://unitedstatesofamericasuperintelligence.com/github/b4rtaz--distributed-llama/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/b4rtaz--distributed-llama/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/b4rtaz--distributed-llama.svg" alt="Ranked #2,528 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 1,005: InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
8,108 starsPythonApache-2.0Last push Oct 16, 2026
Rank 6,966: mukel/llama3.java
Llama 3+ inference in pure Java
820 starsJavaMITLast push Apr 24, 2026
Rank 3,926: beam-cloud/beta9
Ultrafast serverless GPU inference, sandboxes, and background jobs
1,824 starsGoAGPL-3.0Last push Oct 18, 2026
Rank 8,868: jaylfc/taOS
Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framewor…
566 starsPythonAGPL-3.0Last push Oct 18, 2026
Rank 1,214: yangjianxin1/Firefly
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya…
6,647 starsPythonNo license file detectedLast push Oct 24, 2024
Rank 2,080: SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
3,813 starsC#MITLast push Oct 17, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 1,005: InternLM/lmdeploy

Rank 6,966: mukel/llama3.java

Rank 3,926: beam-cloud/beta9

Rank 8,868: jaylfc/taOS

Rank 1,214: yangjianxin1/Firefly

Rank 2,080: SciSharp/LLamaSharp

Support Us