← all repositories

itbench-hub/ITBench

An open-source benchmarking framework for evaluating AI agents on enterprise IT automation tasks.

505 stars Jinja LLMOps · EvalAgents
ITBench
Velocity · 7d
+0.4
★ / day
star history

ITBench provides scenarios, agents, and leaderboards for benchmarking AI-driven IT automation. It covers SRE, FinOps, and CISO tasks and is used to evaluate frontier models on agentic enterprise workflows. The project includes a leaderboard, published evaluation results, and integrations with platforms such as Hugging Face and Kaggle.

Frequently asked

What is itbench-hub/ITBench?
An open-source benchmarking framework for evaluating AI agents on enterprise IT automation tasks.
Is ITBench open source?
Yes — itbench-hub/ITBench is open source, released under the Apache-2.0 license.
What language is ITBench written in?
itbench-hub/ITBench is primarily written in Jinja.
How popular is ITBench?
itbench-hub/ITBench has 505 stars on GitHub.
Where can I find ITBench?
itbench-hub/ITBench is on GitHub at https://github.com/itbench-hub/ITBench.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.