llm-d 1.0 released with flow control, router high availability and a v1 configuration API

On October 20, 2026 llm-d project contributors announced llm-d 1.0, a release of the open distributed inference project that an IBM newsroom announcement says was founded in 2025 by Red Hat, IBM, Google Cloud, CoreWeave and NVIDIA and is now governed by the Cloud Native Computing Foundation (CNCF). The v1.0.0 release notes on GitHub list priority- and fairness-aware flow control with controlled load shedding, router high availability with hot standby and safe rolling updates, and the router configuration API graduating to v1. The notes also say the disaggregated prefill-decode guide now requires LeaderWorkerSet v0.11.1 or newer. The announcement says Google Cloud is integrating llm-d 1.0 into Google Kubernetes Engine; it does not give a date for the CNCF governance change. USASI has not tested this release.12

USASI. (2026, October 20). llm-d 1.0 released with flow control, router high availability and a v1 configuration API. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/llm-d-1-0-released/

@misc{usasi_news_llm_d_1_0_released,
  author = {{USASI}},
  title = {llm-d 1.0 released with flow control, router high availability and a v1 configuration API},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/llm-d-1-0-released/}},
  note = {United States of America Superintelligence. Last updated 2026-10-20}
}