Release

Ai2 releases OLMo-core 3, its open training library, with mixture-of-experts support

Event: Oct 1, 2026 · Published: Oct 1, 2026

Ai2 released version 3 of OLMo-core, the PyTorch training library behind its Olmo models, on October 1, 2026. The release redesigns the library's mixture-of-experts training system, adding expert and pipeline parallelism, a distributed optimizer, grouped matrix multiplication for experts, and support for the MXFP8 number format; Ai2 says it is designed to scale mixture-of-experts training into the trillion-parameter range. The code is licensed under Apache 2.0, and the repository includes Ai2's official training scripts for Olmo 3.1 2 3

Sources

1.
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs (external site: huggingface.co)
Ai2 (Hugging Face blog) · Announcement · published Oct 1, 2026 · accessed Oct 1, 2026
2.
allenai/OLMo-core repository (external site: github.com)
Ai2 · Repository · accessed Oct 1, 2026
3.
ai2-olmo-core package metadata (PyPI JSON API) (external site: pypi.org)
Python Package Index · Other · published Oct 1, 2026 · accessed Oct 1, 2026

Email a correction Report a correction Edit this entry

All news

Cite this page

APA style

USASI. (2026, October 1). Ai2 releases OLMo-core 3, its open training library, with mixture-of-experts support. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/

BibTeX

@misc{usasi_news_ai2_releases_olmo_core_3,
  author = {{USASI}},
  title = {Ai2 releases OLMo-core 3, its open training library, with mixture-of-experts support},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/}},
  note = {United States of America Superintelligence. Last updated 2026-10-01}
}

The date is when this page was last updated. Add the date you read it if your style needs one.

Related catalog entries

Sources

Share or cite this page

Support Us