Release
llama.cpp server adds support for decision models through a /v1/systemone endpoint
On October 2, 2026 the ggml team announced on the Hugging Face blog that the llama.cpp server now supports decision models through a new /v1/systemone endpoint. Decision models score the options a caller supplies instead of generating text. The pull request that adds the endpoint (#29818) was merged into the llama.cpp repository the same day; it describes these models as wrappers around existing embedding-model architectures and adds a decision head and server handling for them. The announcement lists six supported models (Julia-1, Laya, Kev-4B, lev, OpenJev, and Clef), while the pull request itself covers five of them and lists Clef support as a planned follow-up.12
Related catalog entries
Sources
Share or cite this page
- X (opens X)
- Bluesky (opens Bluesky)
- LinkedIn (opens LinkedIn)
- Reddit (opens Reddit)
- Hacker News (opens Hacker News)
- Email (opens your email app)
- RSS updates
Cite this page
APA style
USASI. (2026, October 5). llama.cpp server adds support for decision models through a /v1/systemone endpoint. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/llama-cpp-server-adds-decision-model-support/
BibTeX
@misc{usasi_news_llama_cpp_server_adds_decision_model_support,
author = {{USASI}},
title = {llama.cpp server adds support for decision models through a /v1/systemone endpoint},
year = {2026},
month = oct,
howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/llama-cpp-server-adds-decision-model-support/}},
note = {United States of America Superintelligence. Last updated 2026-10-05}
}The date is when this page was last updated. Add the date you read it if your style needs one.