
lighteval
by huggingface (organization)
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends (description from the project’s GitHub page)
Repository facts
- Stars
- 2,564
- Forks
- 582
- Open issues and pull requests
- 445
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- huggingface · Organization
- Created
- Jan 26, 2024
- Last push
- Oct 6, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/huggingface--lighteval/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/huggingface--lighteval/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/huggingface--lighteval.svg" alt="Ranked #2,996 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 430: confident-ai/deepeval
The LLM Evaluation Framework
18,936 starsPythonApache-2.0Last push Oct 16, 2026
Rank 9,325: relari-ai/continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
519 starsPythonApache-2.0Last push Aug 10, 2026
Rank 3,900: xinshuoweng/AB3DMOT
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
1,846 starsPythonOther licenseLast push Apr 3, 2024
Rank 1,547: Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
5,197 starsPythonOther licenseLast push Oct 17, 2026
Rank 3,588: Cloud-CV/EvalAI
Evaluating state of the art in AI
2,047 starsPythonOther licenseLast push Oct 8, 2026
Rank 314: promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative confi…
26,109 starsTypeScriptMITLast push Oct 18, 2026