# SWE-bench Pro leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/coding-swe-pro

Every model the catalog carries a published SWE-bench Pro value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Repository task completion |
| Tasks | 1,865 repository problems |
| Difficulty | Long-horizon professional engineering |
| Published by | [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](https://arxiv.org/abs/2509.16941) |

A long-horizon repository benchmark built to test realistic software engineering work. Its scores need a task-quality and setup check before they support a coding-agent decision.

## SWE-bench Pro ranking

85 models with a published SWE-bench Pro value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Repository task completion | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Fable 5.2](https://modelchoice.dev/models/claude-fable-5-2) | Anthropic | 93 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Claude Opus 5.5](https://modelchoice.dev/models/claude-opus-5-5) | Anthropic | 89.9 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Claude Sonnet 5.5](https://modelchoice.dev/models/claude-sonnet-5-5) | Anthropic | 81.3 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Claude Fable 5.1](https://modelchoice.dev/models/claude-fable-5-1) | Anthropic | 81.2 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Claude Mythos 5](https://modelchoice.dev/models/claude-mythos-5) | Anthropic | 80.3 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Claude Fable 5](https://modelchoice.dev/models/claude-fable-5) | Anthropic | 80 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Claude Opus 5](https://modelchoice.dev/models/claude-opus-5) | Anthropic | 79.2 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Sakana Fugu-Ultra](https://modelchoice.dev/models/sakana-fugu-ultra) | Sakana AI | 73.7 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Claude Opus 4.8](https://modelchoice.dev/models/claude-opus-4-8) | Anthropic | 69.2 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Ling 3.1 Flash](https://modelchoice.dev/models/ling-3-1-flash) | InclusionAI | 68.74 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Qwen3.8 Max](https://modelchoice.dev/models/qwen3-8-max) | Alibaba | 67.7 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Beam 1.0 501B-A23B](https://modelchoice.dev/models/reflection-beam) | Reflection AI | 66.1 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Beam 1.0 501B-A23B FP8](https://modelchoice.dev/models/reflection-beam-fp8) | Reflection AI | 65.9 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Hy4 preview](https://modelchoice.dev/models/hy4-preview) | Tencent | 65.7 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Beam 1.0 501B-A23B NVFP4](https://modelchoice.dev/models/reflection-beam-nvfp4) | Reflection AI | 65.6 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Ornith-1.5-397B](https://modelchoice.dev/models/ornith-1-5-397b) | Ornith AI | 65.1 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Grok 4.5](https://modelchoice.dev/models/grok-4-5) | xAI | 64.7 | Observed 2026-11-21 · source benchlm:models |
| 18 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 64.6 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Claude Opus 4.7](https://modelchoice.dev/models/claude-opus-4-7) | Anthropic | 64.3 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Claude Opus 4.7 (Adaptive)](https://modelchoice.dev/models/claude-opus-4-7-max) | Anthropic | 64.3 | Last good 2026-11-18 · source benchlm:models |
| 21 | [GPT-5.6 Terra](https://modelchoice.dev/models/gpt-5-6-terra) | OpenAI | 63.4 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Qwen3.8-Omni-Flash](https://modelchoice.dev/models/qwen3-8-omni-flash) | Alibaba | 63.3 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Claude Sonnet 5](https://modelchoice.dev/models/claude-sonnet-5) | Anthropic | 63.2 | Observed 2026-11-21 · source benchlm:models |
| 24 | [GPT-5.6 Luna](https://modelchoice.dev/models/gpt-5-6-luna) | OpenAI | 62.7 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Qwen3.8-Flash-Next](https://modelchoice.dev/models/qwen3-8-flash-next) | Alibaba | 62.5 | Observed 2026-11-21 · source benchlm:models |
| 26 | [Ornith-1.0-397B](https://modelchoice.dev/models/ornith-1-0-397b) | DeepReinforce AI | 62.2 | Observed 2026-11-21 · source benchlm:models |
| 27 | [GLM-5.2](https://modelchoice.dev/models/glm-5-2) | Z.AI | 62.1 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Qwen3.8-27B](https://modelchoice.dev/models/qwen3-8-27b) | Alibaba | 61.7 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Muse Spark 1.1](https://modelchoice.dev/models/muse-spark-1-1) | Meta | 61.5 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Ripple-65B Preview](https://modelchoice.dev/models/ripple-65b-preview) | Ricursive Intelligence | 61.42 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Sage-A1.5](https://modelchoice.dev/models/sage-a1-5) | InternScience | 61.2 | Observed 2026-11-21 · source benchlm:models |
| 32 | [dots3-note Preview](https://modelchoice.dev/models/dots3-note-preview) | Dots Studio | 61 | Observed 2026-11-21 · source benchlm:models |
| 33 | [Qwen3.7 Max](https://modelchoice.dev/models/qwen3-7-max) | Alibaba | 60.6 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Atria Dawn Preview](https://modelchoice.dev/models/atria-dawn-preview) | Shanghai Artificial Intelligence Laboratory | 59.6 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Ornith-1.5-35B-A3B](https://modelchoice.dev/models/ornith-1-5-35b-a3b) | Ornith AI | 59.6 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Laguna S 2.1](https://modelchoice.dev/models/laguna-s-2-1) | Poolside | 59.4 | Observed 2026-11-21 · source benchlm:models |
| 37 | [MiniMax M3](https://modelchoice.dev/models/minimax-m3) | MiniMax | 59 | Observed 2026-11-21 · source benchlm:models |
| 37 | [Sakana Fugu](https://modelchoice.dev/models/sakana-fugu) | Sakana AI | 59 | Observed 2026-11-21 · source benchlm:models |
| 39 | [GPT-5.5](https://modelchoice.dev/models/gpt-5-5) | OpenAI | 58.6 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Kimi K2.6](https://modelchoice.dev/models/kimi-2-6) | Moonshot AI | 58.6 | Observed 2026-11-21 · source benchlm:models |
| 41 | [GLM-5.1](https://modelchoice.dev/models/glm-5-1) | Z.AI | 58.4 | Observed 2026-11-21 · source benchlm:models |
| 42 | [GPT-5.4](https://modelchoice.dev/models/gpt-5-4) | OpenAI | 57.7 | Observed 2026-11-21 · source benchlm:models |
| 43 | [Qwen3.7 Plus](https://modelchoice.dev/models/qwen3-7-plus) | Alibaba | 57.6 | Observed 2026-11-21 · source benchlm:models |
| 44 | [Qwen 3.6 Max (preview)](https://modelchoice.dev/models/qwen3-6-max-preview) | Alibaba | 57.3 | Observed 2026-11-21 · source benchlm:models |
| 45 | [MiMo-V2.5-Pro](https://modelchoice.dev/models/mimo-v2-5-pro) | Xiaomi | 57.2 | Observed 2026-11-21 · source benchlm:models |
| 46 | [Claude Opus 4.5](https://modelchoice.dev/models/claude-opus-4-5) | Anthropic | 57.1 | Observed 2026-11-21 · source benchlm:models |
| 47 | [GPT-5.3 Codex](https://modelchoice.dev/models/gpt-5-3-codex) | OpenAI | 56.8 | Observed 2026-11-21 · source benchlm:models |
| 48 | [Ling 3.0 Flash](https://modelchoice.dev/models/ling-3-0-flash) | InclusionAI | 56.6 | Observed 2026-11-21 · source benchlm:models |
| 48 | [Qwen3.6 Plus](https://modelchoice.dev/models/qwen3-6-plus) | Alibaba | 56.6 | Observed 2026-11-21 · source benchlm:models |
| 50 | [Step 3.7 Flash](https://modelchoice.dev/models/step-3-7-flash) | StepFun | 56.3 | Observed 2026-11-21 · source benchlm:models |
| 51 | [MiniMax M2.7](https://modelchoice.dev/models/minimax-m2-7) | MiniMax | 56.2 | Observed 2026-11-21 · source benchlm:models |
| 52 | [MiMo-V2.5](https://modelchoice.dev/models/mimo-v2-5) | Xiaomi | 56.1 | Observed 2026-11-21 · source benchlm:models |
| 53 | [Inkling-Small](https://modelchoice.dev/models/inkling-small) | Thinking Machines Lab | 55.9 | Observed 2026-11-21 · source benchlm:models |
| 54 | [GPT-5.2](https://modelchoice.dev/models/gpt-5-2) | OpenAI | 55.6 | Observed 2026-11-21 · source benchlm:models |
| 55 | [DeepSeek V4 Pro](https://modelchoice.dev/models/deepseek-v4-pro) | DeepSeek | 55.4 | Observed 2026-11-21 · source benchlm:models |
| 55 | [DeepSeek V4 Pro 0813](https://modelchoice.dev/models/deepseek-v4-pro-max) | DeepSeek | 55.4 | Last good 2026-11-18 · source benchlm:models |
| 57 | [Gemini 3.5 Flash](https://modelchoice.dev/models/gemini-3-5-flash) | Google | 55.1 | Observed 2026-11-21 · source benchlm:models |
| 57 | [GLM-5](https://modelchoice.dev/models/glm-5) | Z.AI | 55.1 | Observed 2026-11-21 · source benchlm:models |
| 59 | [Inkling](https://modelchoice.dev/models/inkling) | Thinking Machines Lab | 54.3 | Observed 2026-11-21 · source benchlm:models |
| 59 | [Spark-X2.6-4B](https://modelchoice.dev/models/spark-x2-6-4b) | SparkLLM | 54.3 | Observed 2026-11-21 · source benchlm:models |
| 61 | [Gemini 3.5 Flash-Lite](https://modelchoice.dev/models/gemini-3-5-flash-lite) | Google | 54.2 | Observed 2026-11-21 · source benchlm:models |
| 62 | [Qwen3.6-27B](https://modelchoice.dev/models/qwen3-6-27b) | Alibaba | 53.5 | Observed 2026-11-21 · source benchlm:models |
| 63 | [Claude Opus 4.6](https://modelchoice.dev/models/claude-opus-4-6) | Anthropic | 53.4 | Observed 2026-11-21 · source benchlm:models |
| 64 | [MAI-Thinking-1](https://modelchoice.dev/models/mai-thinking-1) | Microsoft | 52.8 | Observed 2026-11-21 · source benchlm:models |
| 65 | [DeepSeek V4 Flash 0731](https://modelchoice.dev/models/deepseek-v4-flash-max) | DeepSeek | 52.6 | Observed 2026-11-21 · source benchlm:models |
| 66 | [Muse Spark](https://modelchoice.dev/models/muse-spark) | Meta | 52.4 | Observed 2026-11-21 · source benchlm:models |
| 67 | [Grok 4.20](https://modelchoice.dev/models/grok-4-20-beta) | xAI | 51.8 | Observed 2026-11-21 · source benchlm:models |
| 68 | [Nemotron 3.5 Super VL 120B A12B](https://modelchoice.dev/models/nemotron-3-5-super-vl-120b-a12b) | NVIDIA | 51.78 | Observed 2026-11-21 · source benchlm:models |
| 69 | [Nemotron 3.5 Super VL 120B A12B NVFP4](https://modelchoice.dev/models/nemotron-3-5-super-vl-120b-a12b-nvfp4) | NVIDIA | 51.3 | Observed 2026-11-21 · source benchlm:models |
| 70 | [Muse Glimmer 30B](https://modelchoice.dev/models/muse-glimmer-30b) | Meta | 51.2 | Observed 2026-11-21 · source benchlm:models |
| 71 | [Qwen3.5 397B](https://modelchoice.dev/models/qwen3-5-397b) | Alibaba | 50.9 | Observed 2026-11-21 · source benchlm:models |
| 72 | [Kimi K2.5](https://modelchoice.dev/models/kimi-k2-5) | Moonshot AI | 50.7 | Observed 2026-11-21 · source benchlm:models |
| 73 | [Ornith-1.0-35B](https://modelchoice.dev/models/ornith-1-0-35b) | DeepReinforce AI | 50.4 | Observed 2026-11-21 · source benchlm:models |
| 74 | [Qwen3.6-35B-A3B](https://modelchoice.dev/models/qwen3-6-35b-a3b) | Alibaba | 49.5 | Observed 2026-11-21 · source benchlm:models |
| 75 | [Laguna M.1](https://modelchoice.dev/models/laguna-m-1) | Poolside | 49.2 | Observed 2026-11-21 · source benchlm:models |
| 76 | [Laguna XS 2.1](https://modelchoice.dev/models/laguna-xs-2-1) | Poolside | 47.6 | Observed 2026-11-21 · source benchlm:models |
| 77 | [Ornith-1.5-9B](https://modelchoice.dev/models/ornith-1-5-9b) | Ornith AI | 47.5 | Observed 2026-11-21 · source benchlm:models |
| 78 | [Laguna XS.2](https://modelchoice.dev/models/laguna-xs-2) | Poolside | 46.3 | Observed 2026-11-21 · source benchlm:models |
| 79 | [Ornith-1.0-9B](https://modelchoice.dev/models/ornith-1-0-9b) | DeepReinforce AI | 42.9 | Observed 2026-11-21 · source benchlm:models |
| 80 | [LongCat-Flash-Lite-Sparse](https://modelchoice.dev/models/longcat-flash-lite-sparse) | Meituan | 40.63 | Observed 2026-11-21 · source benchlm:models |
| 81 | [Granite 4.2 30B](https://modelchoice.dev/models/granite-4-2-30b) | IBM | 33.29 | Observed 2026-11-21 · source benchlm:models |
| 82 | [LLaDA2.2-flash](https://modelchoice.dev/models/llada2-2-flash) | InclusionAI | 30.1 | Observed 2026-11-21 · source benchlm:models |
| 83 | [Mellum2.1-12B-A2.5B-Thinking](https://modelchoice.dev/models/mellum2-1-12b-a2-5b-thinking) | JetBrains | 28 | Observed 2026-11-21 · source benchlm:models |
| 84 | [Granite 4.2 8B](https://modelchoice.dev/models/granite-4-2-8b) | IBM | 19.11 | Observed 2026-11-21 · source benchlm:models |
| 85 | [MiniCPM5-2B](https://modelchoice.dev/models/minicpm5-2b) | OpenBMB | 14.4 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
