<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>vLLM — USASI news</title>
    <link>https://unitedstatesofamericasuperintelligence.com/open/vllm/</link>
    <atom:link href="https://unitedstatesofamericasuperintelligence.com/open/vllm/feed.xml" rel="self" type="application/rss+xml"/>
    <description>Dated, sourced news items in the USASI catalog that mention vLLM. Independent project. Not a United States government website.</description>
    <language>en-us</language>
    <lastBuildDate>Mon, 19 Oct 2026 12:00:00 GMT</lastBuildDate>
    <item>
      <title>vLLM 0.32.0 released with a structured decisions endpoint and wider low-precision KV cache support</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/vllm-0-32-0-released/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/vllm-0-32-0-released/</guid>
      <pubDate>Mon, 19 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 18, 2026 the vLLM project published version 0.32.0 on GitHub. The release notes highlight a new POST /v1/systemone endpoint that answers choice, noul and score questions over a structured state, and a new hf tool and reasoning parser that reads a checkpoint's response_template so models that ship it need no model-specific parser. The notes also describe NVFP4 KV cache support on more GPU architectures and new model support, including EmbeddingGemma 2, MiniCPM-V 4.7 and Nemotron 3.5 ASR. Under security, they list fixes for three advisories and say CORS no longer allows every origin by default; breaking changes include dropping Python 3.10 and removing cascade attention. USASI has not tested any of these changes.</description>
    </item>
    <item>
      <title>vLLM 0.31.0 released with a preload command for faster engine restarts</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/vllm-0-31-0-released/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/vllm-0-31-0-released/</guid>
      <pubDate>Tue, 06 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 5, 2026 the vLLM project published version 0.31.0 on GitHub. The release notes highlight a new vllm preload command that launches a weight-cache daemon to keep post-quantized weights in GPU memory across engine restarts, and experimental engine snapshots (vllm snapshot create/restore) that use CRIU to restore a fully initialized TP1 engine. Under security, the notes say per-request mm_processor_kwargs and media_io_kwargs are now rejected unless --trust-request-mm-kwargs is set. The release also lists breaking changes, including the removal of tokenizer_mode=&quot;slow&quot;, and performance work for DeepSeek-V4.1-Flash. USASI has not tested any of these changes.</description>
    </item>
    <item>
      <title>llm-d 0.10.0 focuses on operational hardening and deprecates its own CUDA and AWS images</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/llm-d-0-10-0-released/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/llm-d-0-10-0-released/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>The llm-d project published version 0.10.0 on GitHub on September 29, 2026. The release notes name operational hardening and production readiness as the main themes and describe a new image build arrangement: images from main and official releases go to ghcr.io and are signed publicly with cosign, while images built from open pull requests go to quay.io and are not signed. The notes deprecate the ghcr.io/llm-d/llm-d-cuda image in favor of docker.io/vllm/vllm-openai and the llm-d-aws image in favor of an AWS vLLM container, and say the llmd-fs-connector has been integrated into vLLM as the OffloadingConnector. The llm-d-workload-variant-autoscaler repository has been renamed llm-d-autoscaling. USASI has not tested this release.</description>
    </item>
  </channel>
</rss>
