TRL 1.15.0 released with a fused LM head enabled by default

On October 8, 2026 Hugging Face published version 1.15.0 of TRL on GitHub. The release notes say the SFT, DPO, KTO, GRPO, RLOO and Distillation trainers now score tokens with a fused LM head, a Triton kernel that avoids building the full logits tensor, and that it is on by default; scoring this way needs Triton on a GPU. The notes list breaking changes: a PEFT adapter on lm_head now raises an error, and use_liger_kernel=True is deprecated in the GRPO, RLOO, DPO and KTO trainers and will be removed in v2.0.0. The release also adds selective activation checkpointing in SFT. USASI has not tested these changes.1

USASI. (2026, October 9). TRL 1.15.0 released with a fused LM head enabled by default. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/trl-1-15-0-released/

@misc{usasi_news_trl_1_15_0_released,
  author = {{USASI}},
  title = {TRL 1.15.0 released with a fused LM head enabled by default},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/trl-1-15-0-released/}},
  note = {United States of America Superintelligence. Last updated 2026-10-09}
}