<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Training data and datasets — USASI news</title>
    <link>https://unitedstatesofamericasuperintelligence.com/hubs/data-and-datasets/</link>
    <atom:link href="https://unitedstatesofamericasuperintelligence.com/hubs/data-and-datasets/feed.xml" rel="self" type="application/rss+xml"/>
    <description>Dated, sourced news items about the organizations and records featured in the USASI Training data and datasets hub. Independent project. Not a United States government website.</description>
    <language>en-us</language>
    <lastBuildDate>Tue, 13 Oct 2026 12:00:00 GMT</lastBuildDate>
    <item>
      <title>TRL 1.15.0 released with a fused LM head enabled by default</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/trl-1-15-0-released/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/trl-1-15-0-released/</guid>
      <pubDate>Fri, 09 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 8, 2026 Hugging Face published version 1.15.0 of TRL on GitHub. The release notes say the SFT, DPO, KTO, GRPO, RLOO and Distillation trainers now score tokens with a fused LM head, a Triton kernel that avoids building the full logits tensor, and that it is on by default; scoring this way needs Triton on a GPU. The notes list breaking changes: a PEFT adapter on lm_head now raises an error, and use_liger_kernel=True is deprecated in the GRPO, RLOO, DPO and KTO trainers and will be removed in v2.0.0. The release also adds selective activation checkpointing in SFT. USASI has not tested these changes.</description>
    </item>
    <item>
      <title>Ai2's Bolmo byte-level language model research is published in Nature, with new checkpoints</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/ai2-bolmo-research-published-in-nature/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/ai2-bolmo-research-published-in-nature/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>research</category>
      <description>Ai2 said on October 7, 2026 that the research behind Bolmo, its family of fully open byte-level language models introduced the previous December, has been published in Nature. Ai2 writes that the paper applies the same &quot;byteifying&quot; process to Qwen 3 8B and Llama 3 8B to create two new byte-level models, Bwen 8B and Blama 8B, and that it is releasing new checkpoints, including Stage 1 checkpoints, on Hugging Face. The Bwen 8B model card describes it as Qwen3 8B Base retrofitted to operate over bytes instead of tokens and lists the Apache 2.0 license. USASI has not tested these models.</description>
    </item>
    <item>
      <title>Diffusers 0.41.0 adds a Qwen-Image 2.1 pipeline and deprecates ONNX support</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/diffusers-0-41-0-released/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/diffusers-0-41-0-released/</guid>
      <pubDate>Thu, 08 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 6, 2026 Hugging Face published Diffusers 0.41.0 on GitHub. The release notes say it adds Qwen-Image 2.1, with text-to-image generation, image editing, native transparency, and LoRA training, and introduces tensor-parallel checkpoint loading in which each rank reads its own slice of sharded weights. The notes deprecate ONNX support in favor of Optimum and remove previously deprecated APIs, including the LuminaText2ImgPipeline and Lumina2Text2ImgPipeline aliases. They also say minor releases will now be coordinated around new model integrations, as in Transformers. Qwen-Image 2.1 is a third-party model and is not a catalog entry; the notes do not state its license.</description>
    </item>
    <item>
      <title>Transformers 5.19.0 adds the EmbeddingGemma2 multimodal embedding model</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/transformers-5-19-0-adds-embeddinggemma2/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/transformers-5-19-0-adds-embeddinggemma2/</guid>
      <pubDate>Wed, 07 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 6, 2026 Hugging Face published version 5.19.0 of its Transformers library on GitHub. The release notes add support for EmbeddingGemma2, which the notes describe as a multimodal embedding model from Google built on the Gemma 4 architecture that encodes text, images, audio, and video into a shared 768-dimensional vector space and uses Matryoshka Representation Learning so embeddings can be truncated to 512, 256, or 128 dimensions. The notes also list breaking changes: every mixture-of-experts model that computes router logits now returns them when output_router_logits=True, the &quot;paged|&quot; prefix for SDPA and flash attention implementations is deprecated in favor of continuous batching on the regular functions, and Owlv2ForObjectDetection.embed_image_query now selects the query box by objectness score. EmbeddingGemma2 itself is a Google model and is not a separate catalog entry; USASI has not tested these changes.</description>
    </item>
    <item>
      <title>llama.cpp server adds support for decision models through a /v1/systemone endpoint</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/llama-cpp-server-adds-decision-model-support/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/llama-cpp-server-adds-decision-model-support/</guid>
      <pubDate>Mon, 05 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 2, 2026 the ggml team announced on the Hugging Face blog that the llama.cpp server now supports decision models through a new /v1/systemone endpoint. Decision models score the options a caller supplies instead of generating text. The pull request that adds the endpoint (#29818) was merged into the llama.cpp repository the same day; it describes these models as wrappers around existing embedding-model architectures and adds a decision head and server handling for them. The announcement lists six supported models (Julia-1, Laya, Kev-4B, lev, OpenJev, and Clef), while the pull request itself covers five of them and lists Clef support as a planned follow-up.</description>
    </item>
    <item>
      <title>Ai2 open-sources AstaBrief 8B, a model for writing cited scientific reports</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/ai2-open-sources-astabrief-8b/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/ai2-open-sources-astabrief-8b/</guid>
      <pubDate>Sun, 04 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On October 2, 2026 Ai2 announced that it is open-sourcing AstaBrief 8B, a model that turns a research question and retrieved literature excerpts into a cited report, along with its training data. Ai2 says the model was built from Qwen3-8B using supervised fine-tuning and direct preference optimization, and that it is available as Fast mode in the &quot;Generate a report&quot; feature of Asta, its platform for scientific work. The Hugging Face model card lists the Apache 2.0 license. Ai2 notes that most of the training and evaluation was completed in 2025 and that it has not rerun the full evaluation against today's frontier models.</description>
    </item>
    <item>
      <title>Ai2 releases OLMo-core 3, its open training library, with mixture-of-experts support</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/</guid>
      <pubDate>Thu, 01 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>Ai2 released version 3 of OLMo-core, the PyTorch training library behind its Olmo models, on October 1, 2026. The release redesigns the library's mixture-of-experts training system, adding expert and pipeline parallelism, a distributed optimizer, grouped matrix multiplication for experts, and support for the MXFP8 number format; Ai2 says it is designed to scale mixture-of-experts training into the trillion-parameter range. The code is licensed under Apache 2.0, and the repository includes Ai2's official training scripts for Olmo 3.</description>
    </item>
    <item>
      <title>Hugging Face adds reinforcement learning environments to the Hub as tagged dataset repositories</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/hugging-face-adds-rl-environments-to-the-hub/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/hugging-face-adds-rl-environments-to-the-hub/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>Hugging Face announced RL Environments on the Hub on September 28, 2026. The post says there is no new repository type, registry, or sign-up: an environment is published as a dataset repository with the rl-environment tag plus a tag for each framework that can load its files, and the Hub offers an RL Environments filter. The post says four environment frameworks are registered as dataset libraries, each with its own tag: Harbor, Verifiers, OpenEnv, and NeMo Gym. The &quot;Use this dataset&quot; button provides a command to run an environment in a given framework, and frameworks run environments locally or on a supported cloud backend such as Hugging Face Jobs. The post says adding a tag does not start a job or sandbox. USASI has not tested this feature.</description>
    </item>
    <item>
      <title>Together AI publishes Tev1-4B-experimental, a decision model whose weights license is not yet final</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/together-ai-publishes-tev1-4b-experimental/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/together-ai-publishes-tev1-4b-experimental/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>Together AI published Tev1-4B-experimental on September 23, 2026: an experimental 4B decision model, fine-tuned from Qwen3.5-4B, that is trained to choose one option from a structured state, question and list of choices. Together AI's blog post says the model is available on its serverless platform and walks through fine-tuning a similar classifier with code from the togethercomputer/tev1 GitHub repository. The weights are posted on Hugging Face, but the model card says the release license for the fine-tuned weights is still being finalized, while the base Qwen3.5-4B model is Apache-2.0. The card also says prompt injection, multilingual behavior and calibration have not been comprehensively evaluated. USASI has not tested the model.</description>
    </item>
    <item>
      <title>Common Crawl releases experimental web graph embeddings for web hosts</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/common-crawl-releases-web-graph-embeddings/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/common-crawl-releases-web-graph-embeddings/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>On September 7, 2026, Common Crawl published an experimental dataset of 128-dimensional embeddings for web hosts, learned from hyperlinks alone in its host-level web graph for the November 2025, December 2025, and January 2026 crawls. The model uses no page text, metadata, or hostnames and was trained only on hosts with at least eight links. The data is published as Parquet files on Common Crawl's S3 bucket and on Hugging Face, where the dataset card says its use is subject to the Common Crawl Terms of Use; the source code is on GitHub. Common Crawl says it is yet to be seen whether it will publish graph embeddings on a regular basis.</description>
    </item>
    <item>
      <title>NVIDIA agrees to acquire Hugging Face; the deal has not yet closed</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/nvidia-agrees-to-acquire-hugging-face/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/nvidia-agrees-to-acquire-hugging-face/</guid>
      <pubDate>Tue, 29 Sep 2026 12:00:00 GMT</pubDate>
      <category>acquisition</category>
      <description>NVIDIA entered into a definitive agreement to acquire Hugging Face, Inc. on September 2, 2026, and announced it the next day. NVIDIA's Form 8-K says the transaction is expected to close in the first half of 2027, subject to closing conditions including regulatory approvals, so Hugging Face is still listed as a privately held company with no parent organization. NVIDIA says the Hugging Face platform will stay open to models from other developers and will not require NVIDIA hardware.</description>
    </item>
    <item>
      <title>Ai2 releases BenchMIRT, a method, code, and data for auditing LLM benchmarks prompt by prompt</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-benchmirt/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-benchmirt/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>research</category>
      <description>Ai2 introduced BenchMIRT on September 1, 2026, describing it as a method for auditing LLM benchmarks at the level of individual prompts. According to Ai2, it uses multidimensional Item Response Theory to estimate which underlying capabilities are most closely associated with getting each question right. Ai2 published a technical report, code on GitHub, and data in a Hugging Face collection. The post does not state a license. USASI has not tested this method.</description>
    </item>
    <item>
      <title>Sentence Transformers 6.0.0 adds MultiVectorEncoder for ColBERT-style late-interaction models</title>
      <link>https://unitedstatesofamericasuperintelligence.com/news/sentence-transformers-6-0-0-adds-multivectorencoder/</link>
      <guid isPermaLink="true">https://unitedstatesofamericasuperintelligence.com/news/sentence-transformers-6-0-0-adds-multivectorencoder/</guid>
      <pubDate>Tue, 13 Oct 2026 12:00:00 GMT</pubDate>
      <category>release</category>
      <description>Sentence Transformers version 6.0.0 was published on GitHub on August 18, 2026. The release notes describe it as a major release that introduces Multi-Vector Embedding models, also known as late-interaction or ColBERT-style models, as a fourth model type, MultiVectorEncoder, alongside SentenceTransformer, CrossEncoder, and SparseEncoder. The notes say PyLate and Stanford-NLP ColBERT checkpoints load directly into it, that the dependency floor moves to transformers v5, and that the release contains breaking changes covered in a migration guide. USASI has not tested this release.</description>
    </item>
  </channel>
</rss>
