Rank #3,407 2,191 starsTypeScript

node-llama-cpp

by withcatai (organization)

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 2,191
Forks: 240
Open issues and pull requests: 43
Primary language: TypeScript
License: MIT License (MIT)
Owner: withcatai · Organization
Created: Aug 12, 2023
Last push: Oct 17, 2026

Topics

Rank #3,407 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #3,407 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #3,407 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/withcatai--node-llama-cpp.svg)](https://unitedstatesofamericasuperintelligence.com/github/withcatai--node-llama-cpp/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/withcatai--node-llama-cpp/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/withcatai--node-llama-cpp.svg" alt="Ranked #3,407 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 8,065: hybridgroup/yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
654 starsGoOther licenseLast push Oct 17, 2026
Rank 4,136: tenstorrent/tt-metal
TT-NN operator library, and TT-Metalium low level kernel programming model.
1,715 starsPythonApache-2.0Last push Oct 18, 2026
Rank 8,611: zhongkaifu/TensorSharp
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-comp…
592 starsC#BSD-3-ClauseLast push Oct 18, 2026
Rank 742: getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10,921 starsTypeScriptMITLast push Apr 23, 2024
Rank 1,372: lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
5,927 starsC++Apache-2.0Last push Oct 18, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 8,065: hybridgroup/yzma

Rank 4,136: tenstorrent/tt-metal

Rank 8,611: zhongkaifu/TensorSharp

Rank 742: getumbrel/llama-gpt

Rank 1,372: lemonade-sdk/lemonade

Rank 4,946: feder-cr/jev

Support Us