llm-colosseum
by OpenGenerativeAI (organization)
Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM (description from the project’s GitHub page)
Repository facts
- Stars
- 1,483
- Forks
- 181
- Open issues and pull requests
- 16
- Primary language
- Jupyter Notebook
- License
- MIT License (MIT)
- Owner
- OpenGenerativeAI · Organization
- Created
- Mar 23, 2024
- Last push
- Mar 21, 2025
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/opengenerativeai--llm-colosseum/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/opengenerativeai--llm-colosseum/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/opengenerativeai--llm-colosseum.svg" alt="Ranked #4,615 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 4,321: NirDiamant/Controllable-RAG-Agent
This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.
1,629 starsJupyter NotebookApache-2.0Last push Oct 10, 2026
Rank 9,486: NisaarAgharia/Advanced_RAG
Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,Agents.
502 starsJupyter NotebookNo license file detectedLast push Apr 26, 2024
Rank 1,082: open-compass/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, rea…
7,527 starsPythonApache-2.0Last push Oct 16, 2026
Rank 2,441: xlang-ai/OSWorld
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
3,217 starsPythonApache-2.0Last push Sep 14, 2026
Rank 3,256: beir-cellar/beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
2,311 starsPythonApache-2.0Last push Oct 16, 2025
Rank 3,329: sierra-research/tau2-bench
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
2,256 starsPythonMITLast push Oct 16, 2026