# SWE-bench (Vals) leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/coding-vals-swe-bench

SWE-bench, Vals AI run. Every model the catalog carries a published SWE-bench (Vals) value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Resolved rate |
| Tasks | Real repository issues by human time bucket |
| Difficulty | Frontier coding agents |
| Published by | [Vals AI SWE-bench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/swebench) |

Vals AI’s independent run of the public SWE-bench issue set, reported by human time-to-fix bucket. Vals removed SWE-bench Verified from its index as saturated on 2026-05-04; this board is the standalone SWE-bench run.

## SWE-bench (Vals) ranking

76 models with a published SWE-bench (Vals) value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Resolved rate | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Opus 5](https://modelchoice.dev/models/claude-opus-5) | Anthropic | 97.0 | Observed 2026-11-21 · source benchlm:models |
| 2 | [DeepSeek V4 Pro](https://modelchoice.dev/models/deepseek-v4-pro) | DeepSeek | 96.4 | Observed 2026-11-21 · source benchlm:models |
| 2 | [DeepSeek V4 Pro 0813](https://modelchoice.dev/models/deepseek-v4-pro-max) | DeepSeek | 96.4 | Last good 2026-11-18 · source benchlm:models |
| 4 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 96.2 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Grok 4.6](https://modelchoice.dev/models/grok-4-6) | xAI | 95.6 | Observed 2026-11-21 · source benchlm:models |
| 6 | [GLM-5.3](https://modelchoice.dev/models/glm-5-3) | Z.AI | 95.4 | Observed 2026-11-21 · source benchlm:models |
| 6 | [GPT-5.6 Terra](https://modelchoice.dev/models/gpt-5-6-terra) | OpenAI | 95.4 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Claude Fable 5](https://modelchoice.dev/models/claude-fable-5) | Anthropic | 95.0 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Kimi K3](https://modelchoice.dev/models/kimi-3) | Moonshot AI | 93.4 | Observed 2026-11-21 · source benchlm:models |
| 10 | [GPT-5.6 Luna](https://modelchoice.dev/models/gpt-5-6-luna) | OpenAI | 93.0 | Observed 2026-11-21 · source benchlm:models |
| 11 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 92.0 | Observed 2026-11-21 · source benchlm:models |
| 12 | [DeepSeek V4 Flash 0731](https://modelchoice.dev/models/deepseek-v4-flash-max) | DeepSeek | 88.8 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Claude Opus 4.8](https://modelchoice.dev/models/claude-opus-4-8) | Anthropic | 88.6 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Grok 4.5](https://modelchoice.dev/models/grok-4-5) | xAI | 86.6 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Muse Spark 1.2](https://modelchoice.dev/models/muse-spark-1-2) | Meta | 86.6 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Qwen3.8-27B](https://modelchoice.dev/models/qwen3-8-27b) | Alibaba | 86.0 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Qwen3.8 Max](https://modelchoice.dev/models/qwen3-8-max) | Alibaba | 85.6 | Observed 2026-11-21 · source benchlm:models |
| 18 | [GLM-5.2](https://modelchoice.dev/models/glm-5-2) | Z.AI | 82.8 | Observed 2026-11-21 · source benchlm:models |
| 19 | [GPT-5.5](https://modelchoice.dev/models/gpt-5-5) | OpenAI | 82.6 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Inkling-Small](https://modelchoice.dev/models/inkling-small) | Thinking Machines Lab | 82.2 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Claude Opus 4.7](https://modelchoice.dev/models/claude-opus-4-7) | Anthropic | 82.0 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Muse Spark 1.1](https://modelchoice.dev/models/muse-spark-1-1) | Meta | 82.0 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Gemini 3.7 Flash](https://modelchoice.dev/models/gemini-3-7-flash) | Google | 80.8 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Gemini 3.8 Flash](https://modelchoice.dev/models/gemini-3-8-flash) | Google | 80.0 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Claude Sonnet 5](https://modelchoice.dev/models/claude-sonnet-5) | Anthropic | 79.6 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Composer 2.5](https://modelchoice.dev/models/composer-2-5) | Cursor | 79.6 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Gemini 3.6 Flash](https://modelchoice.dev/models/gemini-3-6-flash) | Google | 79.6 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Gemini 3.1 Pro](https://modelchoice.dev/models/gemini-3-1-pro) | Google | 78.8 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Gemini 3.5 Flash](https://modelchoice.dev/models/gemini-3-5-flash) | Google | 78.8 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Claude Opus 4.6 (Adaptive)](https://modelchoice.dev/models/claude-opus-4-6-thinking) | Anthropic | 78.2 | Observed 2026-11-21 · source benchlm:models |
| 30 | [GPT-5.4](https://modelchoice.dev/models/gpt-5-4) | OpenAI | 78.2 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Kimi K2.7 Code](https://modelchoice.dev/models/kimi-k2-7-code) | Moonshot AI | 78.2 | Observed 2026-11-21 · source benchlm:models |
| 33 | [GPT-5.3 Codex](https://modelchoice.dev/models/gpt-5-3-codex) | OpenAI | 78.0 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Inkling](https://modelchoice.dev/models/inkling) | Thinking Machines Lab | 77.6 | Observed 2026-11-21 · source benchlm:models |
| 35 | [Claude Sonnet 4.6](https://modelchoice.dev/models/claude-sonnet-4-6) | Anthropic | 77.4 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Claude Opus 4.5 Thinking](https://modelchoice.dev/models/claude-opus-4-5-thinking) | Anthropic | 76.4 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Gemini 3 Pro](https://modelchoice.dev/models/gemini-3-pro) | Google | 76.4 | Observed 2026-11-21 · source benchlm:models |
| 36 | [GLM-5.1](https://modelchoice.dev/models/glm-5-1) | Z.AI | 76.4 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Kimi K2.6](https://modelchoice.dev/models/kimi-2-6) | Moonshot AI | 76.2 | Observed 2026-11-21 · source benchlm:models |
| 40 | [GPT-5.2](https://modelchoice.dev/models/gpt-5-2) | OpenAI | 75.8 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Gemini 3 Flash](https://modelchoice.dev/models/gemini-3-flash) | Google | 75.0 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Gemini 3.5 Flash-Lite](https://modelchoice.dev/models/gemini-3-5-flash-lite) | Google | 75.0 | Observed 2026-11-21 · source benchlm:models |
| 41 | [MiniMax M3](https://modelchoice.dev/models/minimax-m3) | MiniMax | 75.0 | Observed 2026-11-21 · source benchlm:models |
| 44 | [Muse Spark](https://modelchoice.dev/models/muse-spark) | Meta | 74.4 | Observed 2026-11-21 · source benchlm:models |
| 45 | [MiMo-V2.5-Pro](https://modelchoice.dev/models/mimo-v2-5-pro) | Xiaomi | 74.0 | Observed 2026-11-21 · source benchlm:models |
| 46 | [MiniMax M2.7](https://modelchoice.dev/models/minimax-m2-7) | MiniMax | 73.8 | Observed 2026-11-21 · source benchlm:models |
| 47 | [Qwen3.6 Plus](https://modelchoice.dev/models/qwen3-6-plus) | Alibaba | 73.4 | Observed 2026-11-21 · source benchlm:models |
| 48 | [GPT-5.4 mini](https://modelchoice.dev/models/gpt-5-4-mini) | OpenAI | 73.0 | Observed 2026-11-21 · source benchlm:models |
| 49 | [Qwen 3.6 Max (preview)](https://modelchoice.dev/models/qwen3-6-max-preview) | Alibaba | 72.8 | Observed 2026-11-21 · source benchlm:models |
| 50 | [GPT-5.2-Codex](https://modelchoice.dev/models/gpt-5-2-codex) | OpenAI | 72.4 | Observed 2026-11-21 · source benchlm:models |
| 51 | [Grok 4.20](https://modelchoice.dev/models/grok-4-20-beta) | xAI | 72.2 | Observed 2026-11-21 · source benchlm:models |
| 52 | [GLM-5 (Reasoning)](https://modelchoice.dev/models/glm-5-reasoning) | Z.AI | 71.4 | Last good 2026-11-18 · source benchlm:models |
| 52 | [Grok 4.3](https://modelchoice.dev/models/grok-4-3) | xAI | 71.4 | Observed 2026-11-21 · source benchlm:models |
| 54 | [MiMo-V2.5](https://modelchoice.dev/models/mimo-v2-5) | Xiaomi | 71.0 | Observed 2026-11-21 · source benchlm:models |
| 55 | [Claude Sonnet 4.5 Thinking](https://modelchoice.dev/models/claude-sonnet-4-5-thinking) | Anthropic | 70.0 | Observed 2026-11-21 · source benchlm:models |
| 55 | [Kimi K2.5 (Reasoning)](https://modelchoice.dev/models/kimi-k2-5-reasoning) | Moonshot AI | 70.0 | Last good 2026-11-18 · source benchlm:models |
| 55 | [Qwen3.6-27B](https://modelchoice.dev/models/qwen3-6-27b) | Alibaba | 70.0 | Observed 2026-11-21 · source benchlm:models |
| 58 | [GPT-5.1](https://modelchoice.dev/models/gpt-5-1) | OpenAI | 69.8 | Observed 2026-11-21 · source benchlm:models |
| 58 | [GPT-5.4 nano](https://modelchoice.dev/models/gpt-5-4-nano) | OpenAI | 69.8 | Observed 2026-11-21 · source benchlm:models |
| 60 | [GLM-4.7](https://modelchoice.dev/models/glm-4-7) | Z.AI | 69.4 | Observed 2026-11-21 · source benchlm:models |
| 61 | [GPT-5](https://modelchoice.dev/models/gpt-5) | OpenAI | 69.0 | Observed 2026-11-21 · source benchlm:models |
| 61 | [GPT-5 (high)](https://modelchoice.dev/models/gpt-5-high) | OpenAI | 69.0 | Last good 2026-11-18 · source benchlm:models |
| 61 | [Nemotron 3 Ultra](https://modelchoice.dev/models/nemotron-3-ultra-500b) | NVIDIA | 69.0 | Observed 2026-11-21 · source benchlm:models |
| 64 | [Qwen3.7 Max](https://modelchoice.dev/models/qwen3-7-max) | Alibaba | 68.8 | Observed 2026-11-21 · source benchlm:models |
| 65 | [Claude Haiku 4.5](https://modelchoice.dev/models/claude-haiku-4-5) | Anthropic | 66.6 | Observed 2026-11-21 · source benchlm:models |
| 66 | [Mistral Medium 3.5 128B](https://modelchoice.dev/models/mistral-medium-3-5-128b) | Mistral | 66.4 | Observed 2026-11-21 · source benchlm:models |
| 67 | [Ling 3.0 Flash](https://modelchoice.dev/models/ling-3-0-flash) | InclusionAI | 65.2 | Observed 2026-11-21 · source benchlm:models |
| 68 | [Qwen3.5 Flash](https://modelchoice.dev/models/qwen3-5-flash) | Alibaba | 64.4 | Observed 2026-11-21 · source benchlm:models |
| 69 | [Gemini 3.1 Flash-Lite](https://modelchoice.dev/models/gemini-3-1-flash-lite) | Google | 62.8 | Observed 2026-11-21 · source benchlm:models |
| 70 | [Grok 4](https://modelchoice.dev/models/grok-4) | xAI | 57.8 | Observed 2026-11-21 · source benchlm:models |
| 71 | [Laguna M.1](https://modelchoice.dev/models/laguna-m-1) | Poolside | 57.6 | Observed 2026-11-21 · source benchlm:models |
| 72 | [Laguna XS.2](https://modelchoice.dev/models/laguna-xs-2) | Poolside | 55.2 | Observed 2026-11-21 · source benchlm:models |
| 73 | [Gemini 2.5 Pro](https://modelchoice.dev/models/gemini-2-5-pro) | Google | 54.4 | Observed 2026-11-21 · source benchlm:models |
| 74 | [Grok 4 Fast (Reasoning)](https://modelchoice.dev/models/grok-4-fast-reasoning) | xAI | 45.4 | Observed 2026-11-21 · source benchlm:models |
| 75 | [Grok 4.1 Fast (Reasoning)](https://modelchoice.dev/models/grok-4-1-fast-reasoning) | xAI | 41.4 | Observed 2026-11-21 · source benchlm:models |
| 75 | [Mistral Large 3](https://modelchoice.dev/models/mistral-large-3) | Mistral | 41.4 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
