gpu_poor
by RahulSChand (personal account)
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization (description from the project’s GitHub page)
Repository facts
- Stars
- 1,400
- Forks
- 88
- Open issues and pull requests
- 8
- Primary language
- JavaScript
- License
- No license file detected
- Owner
- RahulSChand · Personal account
- Created
- Sep 12, 2023
- Last push
- Dec 3, 2024
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/rahulschand--gpu-poor/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/rahulschand--gpu-poor/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/rahulschand--gpu-poor.svg" alt="Ranked #4,827 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,627: ashishpatel26/LLM-Finetuning
LLM Finetuning with peft
2,990 starsJupyter NotebookNo license file detectedLast push Aug 1, 2025
Rank 4,406: RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
1,587 starsC++MITLast push Mar 23, 2025
Rank 742: getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10,921 starsTypeScriptMITLast push Apr 23, 2024
Rank 2,080: SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
3,813 starsC#MITLast push Oct 17, 2026
Rank 8,853: xNul/code-llama-for-vscode
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
568 starsPythonMITLast push Jul 31, 2024