Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated purple flowing-wave artwork for kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference, labeled USASI · AI on GitHub, with Personal account · Python · MIT.
Rank #6,220 971 starsPython

Llama-2-Open-Source-LLM-CPU-Inference

by kennethleungty (personal account)

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: towardsdatascience.com)

Repository facts

Stars
971
Forks
205
Open issues and pull requests
15
Primary language
Python
License
MIT License (MIT)
Owner
kennethleungty · Personal account
Created
Jul 6, 2023
Last push
Nov 6, 2023

Topics

Rank #6,220 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #6,220 in AI on GitHubShows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #6,220 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/kennethleungty--llama-2-open-source-llm-cpu-inference.svg)](https://unitedstatesofamericasuperintelligence.com/github/kennethleungty--llama-2-open-source-llm-cpu-inference/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/kennethleungty--llama-2-open-source-llm-cpu-inference/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/kennethleungty--llama-2-open-source-llm-cpu-inference.svg" alt="Ranked #6,220 in AI on GitHub" height="20"></a>

Related projects

Projects that share this one’s GitHub topics.

  • Rank 6,566: The-FinAI/PIXIU

    This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holisti…

    894 starsJupyter NotebookMITLast push Oct 8, 2026

  • Rank 8,119: webis-de/small-text

    Active Learning for Text Classification in Python

    647 starsPythonMITLast push Oct 12, 2026

  • Rank 9,068: EricFillion/happy-transformer

    Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

    545 starsPythonApache-2.0Last push Jan 10, 2026

  • Rank 768: bigscience-workshop/petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    10,639 starsPythonMITLast push Sep 7, 2024

  • Rank 1,695: trigaten/Learn_Prompting

    Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community

    4,739 starsMDXOther licenseLast push Jan 14, 2025

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project