VLMEvalKit
by open-compass (organization)
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks (description from the project’s GitHub page)
Repository facts
- Stars
- 4,445
- Forks
- 801
- Open issues and pull requests
- 335
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- open-compass · Organization
- Created
- Dec 1, 2023
- Last push
- Oct 16, 2026
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/open-compass--vlmevalkit/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/open-compass--vlmevalkit/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/open-compass--vlmevalkit.svg" alt="Ranked #1,801 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 6,153: xing61/zzz-api
企业级稳定的OpenAI、Claude、Gemini等的API接口-For企业和开发者。OpenAI的api proxy，支持ChatGPT的API调用，支持Anthropic claude的官方接口形式，支持Google gemini的官方接口形式，支持：gpt-5，sora。不需要openai Key, 不需要买openai的账号，不需要美元的银行卡，…
990 starsNo license file detectedLast push Sep 13, 2026
Rank 2,905: om-ai-lab/OmAgent
[EMNLP-2024] Build multimodal language agents for fast prototype and production
2,669 starsPythonApache-2.0Last push Oct 16, 2026
Rank 7,138: frankroeder/parrot.nvim
parrot.nvim 🦜 - the plugin that brings stochastic parrots to Neovim.
792 starsLuaOther licenseLast push Oct 12, 2026
Rank 187: songquanpeng/one-api
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM…
37,193 starsJavaScriptMITLast push Jan 9, 2026
Rank 7,006: CHATS-lab/verbalized-sampling
Verbalized Sampling, a training-free prompting strategy to mitigate mode collapse in LLMs by requesting responses with probabilities. Achieves 2-3x diversity improvement while mai…
813 starsPythonOther licenseLast push Jan 3, 2026
Rank 2,889: nicepkg/aide
Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪
2,685 starsTypeScriptMITLast push May 6, 2025