Rank #1,795 4,456 starsPython

lmms-eval

by EvolvingLMMs-Lab (organization)

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 4,456
Forks: 676
Open issues and pull requests: 60
Primary language: Python
License: Other license
Owner: EvolvingLMMs-Lab · Organization
Created: Mar 7, 2024
Last push: Oct 17, 2026

Topics

Rank #1,795 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #1,795 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #1,795 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/evolvinglmms-lab--lmms-eval.svg)](https://unitedstatesofamericasuperintelligence.com/github/evolvinglmms-lab--lmms-eval/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/evolvinglmms-lab--lmms-eval/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/evolvinglmms-lab--lmms-eval.svg" alt="Ranked #1,795 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 7,240: OpenMOSS/MOSS-VL
An open-weight 11B model series for long-form and real-time video understanding
774 starsC++Apache-2.0Last push Oct 14, 2026
Rank 7,101: xinxuxin/keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
799 starsPythonOther licenseLast push Sep 15, 2026
Rank 8,237: HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs an…
632 starsPythonMITLast push Oct 4, 2026
Rank 6,522: EvolvingLMMs-Lab/NEO
NEO Series: Native Vision-Language Models from First Principles
902 starsPythonApache-2.0Last push Jul 27, 2026
Rank 8,544: onyx-dot-app/EnterpriseRAG-Bench
Dataset and benchmark for RAG on company internal documents.
599 starsMITLast push Sep 3, 2026
Rank 3,761: NVIDIA-AI-Blueprints/video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual…
1,931 starsPythonApache-2.0Last push Oct 18, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 7,240: OpenMOSS/MOSS-VL

Rank 7,101: xinxuxin/keystone-bench

Rank 8,237: HowieHwong/TrustLLM

Rank 6,522: EvolvingLMMs-Lab/NEO

Rank 8,544: onyx-dot-app/EnterpriseRAG-Bench

Rank 3,761: NVIDIA-AI-Blueprints/video-search-and-summarization

Support Us