# AA ITBench leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/agentic-aa-itbench

Artificial Analysis ITBench-AA. Every model the catalog carries a published AA ITBench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | Task success rate |
| Tasks | IT incident-response tasks |
| Difficulty | Enterprise IT operations |
| Published by | [Artificial Analysis ITBench-AA Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/itbench-aa) |

An independently evaluated IT-operations benchmark from Artificial Analysis.

## AA ITBench ranking

27 models with a published AA ITBench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Task success rate | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 56.2 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Step 5 Preview](https://modelchoice.dev/models/step-5-preview) | StepFun | 55.6 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Gemini 3.8 Flash](https://modelchoice.dev/models/gemini-3-8-flash) | Google | 52.5 | Observed 2026-11-21 · source benchlm:models |
| 4 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 51.2 | Observed 2026-11-21 · source benchlm:models |
| 5 | [GPT-5.6 Terra](https://modelchoice.dev/models/gpt-5-6-terra) | OpenAI | 51.0 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Claude Fable 5.1](https://modelchoice.dev/models/claude-fable-5-1) | Anthropic | 49.5 | Observed 2026-11-21 · source benchlm:models |
| 7 | [GPT-6 Sol](https://modelchoice.dev/models/gpt-6-sol) | OpenAI | 49.4 | Observed 2026-11-21 · source benchlm:models |
| 8 | [GPT-6 Astra](https://modelchoice.dev/models/gpt-6-astra) | OpenAI | 48.6 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Kimi K3](https://modelchoice.dev/models/kimi-3) | Moonshot AI | 47.7 | Observed 2026-11-21 · source benchlm:models |
| 10 | [DeepSeek V4.1 Flash 1017](https://modelchoice.dev/models/deepseek-v4-1-flash) | DeepSeek | 46.9 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Claude Opus 4.7](https://modelchoice.dev/models/claude-opus-4-7) | Anthropic | 46.7 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Claude Opus 4.7 (Adaptive)](https://modelchoice.dev/models/claude-opus-4-7-max) | Anthropic | 46.7 | Last good 2026-11-18 · source benchlm:models |
| 13 | [GLM-5.3](https://modelchoice.dev/models/glm-5-3) | Z.AI | 46.1 | Observed 2026-11-21 · source benchlm:models |
| 14 | [GPT-5.5](https://modelchoice.dev/models/gpt-5-5) | OpenAI | 45.8 | Observed 2026-11-21 · source benchlm:models |
| 15 | [GLM-5.2](https://modelchoice.dev/models/glm-5-2) | Z.AI | 42.7 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Qwen3.7 Max](https://modelchoice.dev/models/qwen3-7-max) | Alibaba | 42.5 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Grok 4.7](https://modelchoice.dev/models/grok-4-7) | xAI | 42.1 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Gemini 3.5 Flash](https://modelchoice.dev/models/gemini-3-5-flash) | Google | 40.3 | Observed 2026-11-21 · source benchlm:models |
| 18 | [GLM-5.1](https://modelchoice.dev/models/glm-5-1) | Z.AI | 40.3 | Observed 2026-11-21 · source benchlm:models |
| 18 | [GPT-5.6 Luna](https://modelchoice.dev/models/gpt-5-6-luna) | OpenAI | 40.3 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Claude Opus 5.5](https://modelchoice.dev/models/claude-opus-5-5) | Anthropic | 38.2 | Observed 2026-11-21 · source benchlm:models |
| 21 | [MiMo-V2.5-Pro](https://modelchoice.dev/models/mimo-v2-5-pro) | Xiaomi | 38.2 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Gemma 4 31B](https://modelchoice.dev/models/gemma-4-31b) | Google | 37.3 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Qwen3.5-27B](https://modelchoice.dev/models/qwen3-5-27b) | Alibaba | 35.5 | Observed 2026-11-21 · source benchlm:models |
| 25 | [GPT-5.4 mini](https://modelchoice.dev/models/gpt-5-4-mini) | OpenAI | 35.2 | Observed 2026-11-21 · source benchlm:models |
| 26 | [Muse Spark 1.3](https://modelchoice.dev/models/muse-spark-1-3) | Meta | 33.2 | Last good 2026-10-08 · source benchlm:models |
| 27 | [GPT-OSS 120B](https://modelchoice.dev/models/gpt-oss-120b) | OpenAI | 5.6 | Last good 2026-09-22 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
