Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated blue flowing-wave artwork for toverainc/willow-inference-server, labeled USASI · AI on GitHub, with Organization · Python · Apache-2.0.
Rank #9,405 511 starsPython

willow-inference-server

by toverainc (organization)

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS (description from the project’s GitHub page)

View on GitHub (external site: github.com)

Repository facts

Stars
511
Forks
60
Open issues and pull requests
41
Primary language
Python
License
Apache License 2.0 (Apache-2.0)
Owner
toverainc · Organization
Created
Feb 3, 2023
Last push
Feb 12, 2026

Topics

Rank #9,405 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #9,405 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #9,405 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/toverainc--willow-inference-server.svg)](https://unitedstatesofamericasuperintelligence.com/github/toverainc--willow-inference-server/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/toverainc--willow-inference-server/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/toverainc--willow-inference-server.svg" alt="Ranked #9,405 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 4,701: ARahim3/mlx-tune

    Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

    1,444 starsPythonApache-2.0Last push Jun 23, 2026

  • Rank 7,162: mezbaul-h/june

    Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit

    788 starsPythonMITLast push Aug 12, 2024

  • Rank 2,519: HeyWillow/willow

    Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

    3,127 starsCApache-2.0Last push Oct 1, 2026

  • Rank 610: abus-aikorea/voice-pro

    Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube downloa…

    13,159 starsPythonGPL-3.0Last push Jul 13, 2026

  • Rank 467: leon-ai/leon

    🧠 Leon is your open-source personal assistant.

    17,587 starsTypeScriptMITLast push Oct 12, 2026

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project