
petals
by bigscience-workshop (organization)
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading (description from the project’s GitHub page)
Repository facts
- Stars
- 10,639
- Forks
- 651
- Open issues and pull requests
- 114
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- bigscience-workshop · Organization
- Created
- Jun 12, 2022
- Last push
- Sep 7, 2024
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/bigscience-workshop--petals/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/bigscience-workshop--petals/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/bigscience-workshop--petals.svg" alt="Ranked #768 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 4,898: hiyouga/FastEdit
🩹Editing large language models within 10 seconds⚡
1,369 starsPythonApache-2.0Last push Aug 13, 2023
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 3,021: X-PLUG/mPLUG-Owl
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
2,539 starsPythonMITLast push Apr 2, 2025
Rank 6,220: kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
971 starsPythonMITLast push Nov 6, 2023
Rank 6,577: explosion/curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
890 starsPythonMITLast push Apr 17, 2024
Rank 4,832: explosion/spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
1,397 starsPythonMITLast push Sep 27, 2026