llama.cpp
llama.cpp is a runtime maintained by ggml team at Hugging Face (ggml.ai, acquired by Hugging Face in 2026), with the ggml-org community786. Its source code is public1 under the MIT License3.
llama.cpp is a C/C++ library and set of tools for running LLM and vision-language model inference locally or in the cloud, built on the ggml tensor library. It supports integer quantization and many hardware backends. It includes a command-line interface and an OpenAI-compatible server.2
- Repository: Repository (external site: github.com)
- Website: Website (external site: llama.app)
- License: LICENSE (external site: github.com)
- Release notes: Releases (external site: github.com)
Availability and license
Component reuse rights
- weights
- Unknown — no complete fact-level rights review
- code
- Unknown — no complete fact-level rights review
- data
- Unknown — no complete fact-level rights review
- documentation
- Unknown — no complete fact-level rights review
No complete system-rights review is recorded for this release.
Public materials checklist
| Item | Status | Notes and evidence |
|---|---|---|
| Source codeIs the source code publicly readable? | Public | 1 |
| DocumentationIs user documentation published? | Public | Documentation is kept in the repository README and docs directory.2 |
| InstallationAre installation instructions or packages publicly available? | Public | The README documents an install script on llama.app, Docker images, prebuilt binaries on the releases page, and building from source.2 |
| Supported platformsAre supported operating systems or hardware documented? | Public | The README lists CPU and GPU backends including Metal, CUDA, HIP, Vulkan, SYCL, and MUSA. Releases include prebuilt binaries for macOS, Linux, Windows, and Android.24 |
| Release statusAre versioned releases published? | Public | Versioned (v0.x) releases and frequent numbered builds are published on GitHub.4 |
What it is useful for
Organization context
Provenance and derivatives
Catalog records that name this entry in their provenance:
In the news
llama.cpp server adds support for decision models through a /v1/systemone endpoint
On October 2, 2026 the ggml team announced on the Hugging Face blog that the llama.cpp server now supports decision models through a new /v1/systemone endpoint. Decision models score the options a caller supplies instead of generating text. The pull request that adds the endpoint (#29818) was merged into the llama.cpp repository the same day; it describes these models as wrappers around existing embedding-model architectures and adds a decision head and server handling for them. The announcement lists six supported models (Julia-1, Laya, Kev-4B, lev, OpenJev, and Clef), while the pull request itself covers five of them and lists Clef support as a planned follow-up.
U.S. eligibility
Eligible · basis: U.S.-governed project
ggml.ai, the company Georgi Gerganov founded in 2023 to support ggml development, says it was acquired by Hugging Face in 2026. Hugging Face's February 20, 2026 announcement says the ggml team joined Hugging Face, dedicates all of its time to maintaining llama.cpp, and keeps leadership of the project's technical direction, while the project stays open source and community driven. The documented maintaining entity is therefore the ggml team within Hugging Face, a U.S. company in this catalog. NVIDIA's pending agreement to acquire Hugging Face would not change the U.S. basis. Eligibility rests on this documented ownership and maintenance, not on contributors' nationality.7869
Sources
This listing is not an endorsement, a safety assessment, or a federal approval.
Share or cite this page
- X (opens X)
- Bluesky (opens Bluesky)
- LinkedIn (opens LinkedIn)
- Reddit (opens Reddit)
- Hacker News (opens Hacker News)
- Email (opens your email app)
- RSS updates
Cite this page
APA style
USASI. (2026, October 1). llama.cpp. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/open/llama-cpp/
BibTeX
@misc{usasi_llama_cpp,
author = {{USASI}},
title = {llama.cpp},
year = {2026},
month = oct,
howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/open/llama-cpp/}},
note = {United States of America Superintelligence. Last updated 2026-10-01}
}The date is when this page was last updated. Add the date you read it if your style needs one.
For maintainers: a “Listed in USASI” badge
Links to this page. It says the entry is listed, not endorsed or rated. About the badge
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/open/llama-cpp/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/open/llama-cpp/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/listed.svg" alt="Listed in the USASI catalog" height="20"></a>