# Bug Hunt Bench leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/coding-bug-hunt-bench

Every model the catalog carries a published Bug Hunt Bench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Strict planted bugs fixed |
| Tasks | 105 planted bugs across two production TypeScript repositories |
| Difficulty | Blind production-repository bug finding and repair |
| Published by | [Bug Hunt Bench method, caveats, and definitions](https://bughunt.productcompass.pm/method) |

A blind-graded coding-agent benchmark with 105 planted bugs across two production TypeScript repositories.

## Bug Hunt Bench ranking

30 models with a published Bug Hunt Bench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Strict planted bugs fixed | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Gemini 4 Neon](https://modelchoice.dev/models/gemini-4-neon) | Google | 63.0 | Observed 2026-11-21 · source benchlm:models |
| 2 | [GPT-6.2 Astra](https://modelchoice.dev/models/gpt-6-2-astra) | OpenAI | 62.7 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Claude Fable 5.2](https://modelchoice.dev/models/claude-fable-5-2) | Anthropic | 58.0 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Gemini 4 Carbon](https://modelchoice.dev/models/gemini-4-carbon) | Google | 57.3 | Observed 2026-11-21 · source benchlm:models |
| 5 | [GPT-6.2 Sol](https://modelchoice.dev/models/gpt-6-2-sol) | OpenAI | 54.7 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Claude Sonnet 5.5](https://modelchoice.dev/models/claude-sonnet-5-5) | Anthropic | 51.3 | Observed 2026-11-21 · source benchlm:models |
| 7 | [GPT-6 Astra](https://modelchoice.dev/models/gpt-6-astra) | OpenAI | 45.0 | Observed 2026-11-21 · source benchlm:models |
| 8 | [GPT-6.1 Sol](https://modelchoice.dev/models/gpt-6-1-sol) | OpenAI | 44.3 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Claude Fable 5.1](https://modelchoice.dev/models/claude-fable-5-1) | Anthropic | 43.0 | Observed 2026-11-21 · source benchlm:models |
| 10 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 42.0 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Muse Wonder Full](https://modelchoice.dev/models/muse-wonder-full) | Meta | 42.0 | Observed 2026-11-21 · source benchlm:models |
| 12 | [Claude Opus 5.5](https://modelchoice.dev/models/claude-opus-5-5) | Anthropic | 41.7 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Gemini 4 Argon](https://modelchoice.dev/models/gemini-4-argon) | Google | 40.7 | Observed 2026-11-21 · source benchlm:models |
| 14 | [DeepSeek V4.1 Flash 1017](https://modelchoice.dev/models/deepseek-v4-1-flash) | DeepSeek | 39.1 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Kimi K3.1 Pro](https://modelchoice.dev/models/kimi-3-1-pro) | Moonshot AI | 36.0 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Gemini 4 Hydrogen](https://modelchoice.dev/models/gemini-4-hydrogen) | Google | 32.7 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Muse Spark 1.3](https://modelchoice.dev/models/muse-spark-1-3) | Meta | 32.2 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Muse Wonder](https://modelchoice.dev/models/muse-wonder) | Meta | 31.7 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Grok 4.7](https://modelchoice.dev/models/grok-4-7) | xAI | 29.0 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Claude Opus 5](https://modelchoice.dev/models/claude-opus-5) | Anthropic | 27.0 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Grok 4.6](https://modelchoice.dev/models/grok-4-6) | xAI | 27.0 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Qwen3.8 Max](https://modelchoice.dev/models/qwen3-8-max) | Alibaba | 25.7 | Observed 2026-11-21 · source benchlm:models |
| 23 | [MiMo-V2.6-Pro](https://modelchoice.dev/models/mimo-v2-6-pro) | Xiaomi | 22.7 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Claude Haiku 5.5](https://modelchoice.dev/models/claude-haiku-5-5) | Anthropic | 21.5 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Kimi K3](https://modelchoice.dev/models/kimi-3) | Moonshot AI | 21.0 | Observed 2026-11-21 · source benchlm:models |
| 26 | [GLM-5.3](https://modelchoice.dev/models/glm-5-3) | Z.AI | 19.0 | Observed 2026-11-21 · source benchlm:models |
| 27 | [GPT-6 Luna](https://modelchoice.dev/models/gpt-6-luna) | OpenAI | 18.3 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Gemini 3.8 Flash](https://modelchoice.dev/models/gemini-3-8-flash) | Google | 18.0 | Observed 2026-11-21 · source benchlm:models |
| 29 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 17.7 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Qwen3.8-27B](https://modelchoice.dev/models/qwen3-8-27b) | Alibaba | 15.0 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
