
FreeToken
by FlashML-org (personal account)
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. (description from the project’s GitHub page)
Repository facts
- Stars
- 14,572
- Forks
- 1,469
- Open issues and pull requests
- 436
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- FlashML-org · Personal account
- Created
- Jul 20, 2026
- Last push
- Oct 18, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/flashml-org--freetoken/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/flashml-org--freetoken/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/flashml-org--freetoken.svg" alt="Ranked #558 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 2,876: lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
2,699 starsPythonMITLast push Oct 18, 2026
Rank 513: modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…
15,871 starsPythonApache-2.0Last push Oct 18, 2026
Rank 13: ollama/ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
183,722 starsGoMITLast push Oct 18, 2026