OpenGenerativeAI/llm-colosseum
A gaming-based benchmark that pits LLMs against each other in Street Fighter III to evaluate decision-making speed, strategy, and adaptability in real time.
Not currently ranked — collecting fresh signals.
star history
The platform runs LLM-vs-LLM matches in Street Fighter III, measuring how well each model responds to game state, makes rapid decisions, and adapts strategy over a full match. Each model earns an ELO rating based on fight outcomes. The benchmark tracks criteria like decision speed, strategic depth, and resilience across hundreds of fights.
Frequently asked
- What is OpenGenerativeAI/llm-colosseum?
- A gaming-based benchmark that pits LLMs against each other in Street Fighter III to evaluate decision-making speed, strategy, and adaptability in real time.
- Is llm-colosseum open source?
- Yes — OpenGenerativeAI/llm-colosseum is open source, released under the MIT license.
- What language is llm-colosseum written in?
- OpenGenerativeAI/llm-colosseum is primarily written in Jupyter Notebook.
- How popular is llm-colosseum?
- OpenGenerativeAI/llm-colosseum has 1.5k stars on GitHub.
- Where can I find llm-colosseum?
- OpenGenerativeAI/llm-colosseum is on GitHub at https://github.com/OpenGenerativeAI/llm-colosseum.