# AA-Omniscience Index leaderboard

Knowledge benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/knowledge-aa-omniscience-index

Artificial Analysis Omniscience Index. Every model the catalog carries a published AA-Omniscience Index value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Knowledge |
| Measure | Index score |
| Tasks | Knowledge questions |
| Difficulty | Broad factual knowledge |
| Published by | [AA-Omniscience: Knowledge and Hallucination Benchmark](https://artificialanalysis.ai/evaluations/omniscience) |

A display-only Artificial Analysis factual knowledge index.

## AA-Omniscience Index ranking

223 models with a published AA-Omniscience Index value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Index score | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Fable 5.2](https://modelchoice.dev/models/claude-fable-5-2) | Anthropic | 66.8 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Gemini 4 Neon](https://modelchoice.dev/models/gemini-4-neon) | Google | 54.8 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Gemini 4 Carbon](https://modelchoice.dev/models/gemini-4-carbon) | Google | 53.5 | Observed 2026-11-21 · source benchlm:models |
| 4 | [GPT-6.2 Astra](https://modelchoice.dev/models/gpt-6-2-astra) | OpenAI | 50.0 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Claude Opus 5.5](https://modelchoice.dev/models/claude-opus-5-5) | Anthropic | 48.1 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Claude Fable 5.1](https://modelchoice.dev/models/claude-fable-5-1) | Anthropic | 46.3 | Observed 2026-11-21 · source benchlm:models |
| 6 | [Gemini 4 Hydrogen](https://modelchoice.dev/models/gemini-4-hydrogen) | Google | 46.3 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Gemini 4 Argon](https://modelchoice.dev/models/gemini-4-argon) | Google | 46.1 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Claude Fable 5](https://modelchoice.dev/models/claude-fable-5) | Anthropic | 43.3 | Observed 2026-11-21 · source benchlm:models |
| 10 | [GPT-6 Astra](https://modelchoice.dev/models/gpt-6-astra) | OpenAI | 42.4 | Observed 2026-11-21 · source benchlm:models |
| 11 | [GPT-6.1 Sol](https://modelchoice.dev/models/gpt-6-1-sol) | OpenAI | 42.0 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GPT-6.2 Sol](https://modelchoice.dev/models/gpt-6-2-sol) | OpenAI | 40.4 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Claude Opus 5](https://modelchoice.dev/models/claude-opus-5) | Anthropic | 37.1 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Gemini 3.1 Pro](https://modelchoice.dev/models/gemini-3-1-pro) | Google | 31.9 | Last good 2026-10-23 · source benchlm:models |
| 15 | [Grok 4.7](https://modelchoice.dev/models/grok-4-7) | xAI | 31.2 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Muse Wonder Full](https://modelchoice.dev/models/muse-wonder-full) | Meta | 30.6 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Claude Sonnet 5.5](https://modelchoice.dev/models/claude-sonnet-5-5) | Anthropic | 30.5 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Grok 4.6](https://modelchoice.dev/models/grok-4-6) | xAI | 30.5 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Kimi K3.1 Pro](https://modelchoice.dev/models/kimi-3-1-pro) | Moonshot AI | 29.9 | Observed 2026-11-21 · source benchlm:models |
| 20 | [GPT-6.1 Terra](https://modelchoice.dev/models/gpt-6-1-terra) | OpenAI | 29.6 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Claude Opus 4.8](https://modelchoice.dev/models/claude-opus-4-8) | Anthropic | 28.8 | Observed 2026-11-21 · source benchlm:models |
| 22 | [Muse Spark 1.1](https://modelchoice.dev/models/muse-spark-1-1) | Meta | 28.1 | Observed 2026-11-21 · source benchlm:models |
| 23 | [Qwen4 Max](https://modelchoice.dev/models/qwen4-max) | Alibaba | 27.7 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Claude Opus 4.7](https://modelchoice.dev/models/claude-opus-4-7) | Anthropic | 27.3 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Claude Opus 4.7 (Adaptive)](https://modelchoice.dev/models/claude-opus-4-7-max) | Anthropic | 27.3 | Last good 2026-11-18 · source benchlm:models |
| 26 | [Muse Spark 1.2](https://modelchoice.dev/models/muse-spark-1-2) | Meta | 27.2 | Observed 2026-11-21 · source benchlm:models |
| 27 | [GPT-6 Sol](https://modelchoice.dev/models/gpt-6-sol) | OpenAI | 27.1 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Gemini 3.7 Flash](https://modelchoice.dev/models/gemini-3-7-flash) | Google | 26.5 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Muse Spark Open](https://modelchoice.dev/models/muse-spark-open) | Meta | 25.8 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Grok 4.5](https://modelchoice.dev/models/grok-4-5) | xAI | 25.3 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Muse Wonder](https://modelchoice.dev/models/muse-wonder) | Meta | 25.1 | Observed 2026-11-21 · source benchlm:models |
| 32 | [Muse Spark 1.3](https://modelchoice.dev/models/muse-spark-1-3) | Meta | 25.0 | Observed 2026-11-21 · source benchlm:models |
| 33 | [Gemini 3.8 Flash](https://modelchoice.dev/models/gemini-3-8-flash) | Google | 23.3 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Gemini 3.6 Flash](https://modelchoice.dev/models/gemini-3-6-flash) | Google | 22.1 | Observed 2026-11-21 · source benchlm:models |
| 35 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 22.0 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Gemini 3.5 Flash](https://modelchoice.dev/models/gemini-3-5-flash) | Google | 21.2 | Observed 2026-11-21 · source benchlm:models |
| 37 | [GPT-5.5](https://modelchoice.dev/models/gpt-5-5) | OpenAI | 20.5 | Observed 2026-11-21 · source benchlm:models |
| 38 | [Kimi K3](https://modelchoice.dev/models/kimi-3) | Moonshot AI | 19.7 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Grok 4.3](https://modelchoice.dev/models/grok-4-3) | xAI | 18.0 | Observed 2026-11-21 · source benchlm:models |
| 40 | [Claude Sonnet 5](https://modelchoice.dev/models/claude-sonnet-5) | Anthropic | 16.5 | Observed 2026-11-21 · source benchlm:models |
| 41 | [Step 5 Preview](https://modelchoice.dev/models/step-5-preview) | StepFun | 16.4 | Observed 2026-11-21 · source benchlm:models |
| 42 | [Inkling 2 Small](https://modelchoice.dev/models/inkling-2-small) | Thinking Machines Lab | 16.1 | Observed 2026-11-21 · source benchlm:models |
| 43 | [Gemini 3 Pro](https://modelchoice.dev/models/gemini-3-pro) | Google | 15.3 | Observed 2026-11-21 · source benchlm:models |
| 44 | [Claude Opus 4.5 Thinking](https://modelchoice.dev/models/claude-opus-4-5-thinking) | Anthropic | 14.0 | Observed 2026-11-21 · source benchlm:models |
| 45 | [Claude Opus 4.6 (Adaptive)](https://modelchoice.dev/models/claude-opus-4-6-thinking) | Anthropic | 13.7 | Observed 2026-11-21 · source benchlm:models |
| 46 | [Qwen3.7 Max](https://modelchoice.dev/models/qwen3-7-max) | Alibaba | 13.5 | Observed 2026-11-21 · source benchlm:models |
| 47 | [Claude Haiku 5.5](https://modelchoice.dev/models/claude-haiku-5-5) | Anthropic | 12.3 | Observed 2026-11-21 · source benchlm:models |
| 48 | [GPT-5.3 Codex](https://modelchoice.dev/models/gpt-5-3-codex) | OpenAI | 10.9 | Last good 2026-10-23 · source benchlm:models |
| 49 | [Qwen3.8 Max Preview](https://modelchoice.dev/models/qwen3-8-max-preview) | Alibaba | 10.5 | Observed 2026-11-21 · source benchlm:models |
| 50 | [Qwen 3.6 Max (preview)](https://modelchoice.dev/models/qwen3-6-max-preview) | Alibaba | 9.2 | Observed 2026-11-21 · source benchlm:models |
| 51 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 7.5 | Last good 2026-10-23 · source benchlm:models |
| 52 | [Muse Ember](https://modelchoice.dev/models/muse-ember) | Meta | 7.4 | Observed 2026-11-21 · source benchlm:models |
| 53 | [Muse Spark](https://modelchoice.dev/models/muse-spark) | Meta | 7.2 | Observed 2026-11-21 · source benchlm:models |
| 54 | [Gemini 3.5 Flash-Lite](https://modelchoice.dev/models/gemini-3-5-flash-lite) | Google | 6.9 | Observed 2026-11-21 · source benchlm:models |
| 55 | [GLM-5.3](https://modelchoice.dev/models/glm-5-3) | Z.AI | 6.0 | Observed 2026-11-21 · source benchlm:models |
| 56 | [GPT-5.4](https://modelchoice.dev/models/gpt-5-4) | OpenAI | 5.8 | Observed 2026-11-21 · source benchlm:models |
| 57 | [GPT-5.1](https://modelchoice.dev/models/gpt-5-1) | OpenAI | 5.4 | Observed 2026-11-21 · source benchlm:models |
| 58 | [Kimi K2.6](https://modelchoice.dev/models/kimi-2-6) | Moonshot AI | 5.3 | Observed 2026-11-21 · source benchlm:models |
| 58 | [Nemotron 3.5 Super VL 120B A12B NVFP4](https://modelchoice.dev/models/nemotron-3-5-super-vl-120b-a12b-nvfp4) | NVIDIA | 5.3 | Observed 2026-11-21 · source benchlm:models |
| 60 | [Mistral Large 4](https://modelchoice.dev/models/mistral-large-4) | Mistral | 5.1 | Observed 2026-11-21 · source benchlm:models |
| 61 | [MiMo-V2-Pro](https://modelchoice.dev/models/mimo-v2-pro) | Xiaomi | 4.6 | Observed 2026-11-21 · source benchlm:models |
| 62 | [GLM-5.2](https://modelchoice.dev/models/glm-5-2) | Z.AI | 4.4 | Observed 2026-11-21 · source benchlm:models |
| 63 | [Nemotron 3.5 Super VL 120B A12B](https://modelchoice.dev/models/nemotron-3-5-super-vl-120b-a12b) | NVIDIA | 4.0 | Observed 2026-11-21 · source benchlm:models |
| 64 | [Nemotron 3 Ultra](https://modelchoice.dev/models/nemotron-3-ultra-500b) | NVIDIA | 3.4 | Observed 2026-11-21 · source benchlm:models |
| 65 | [MiMo-V2.5-Pro](https://modelchoice.dev/models/mimo-v2-5-pro) | Xiaomi | 3.3 | Observed 2026-11-21 · source benchlm:models |
| 66 | [Claude Opus 4.6](https://modelchoice.dev/models/claude-opus-4-6) | Anthropic | 2.4 | Observed 2026-11-21 · source benchlm:models |
| 67 | [Beam 1.0 501B-A23B](https://modelchoice.dev/models/reflection-beam) | Reflection AI | 2.3 | Observed 2026-11-21 · source benchlm:models |
| 68 | [Ling 3.1 Flash](https://modelchoice.dev/models/ling-3-1-flash) | InclusionAI | 2.2 | Last good 2026-10-23 · source benchlm:models |
| 69 | [Grok 4](https://modelchoice.dev/models/grok-4) | xAI | 2.1 | Observed 2026-11-21 · source benchlm:models |
| 70 | [Solar Pro 4](https://modelchoice.dev/models/solar-pro-4) | Upstage | 1.4 | Observed 2026-11-21 · source benchlm:models |
| 71 | [Qwen3.7 Plus](https://modelchoice.dev/models/qwen3-7-plus) | Alibaba | 1.1 | Last good 2026-10-23 · source benchlm:models |
| 72 | [GLM-5.1](https://modelchoice.dev/models/glm-5-1) | Z.AI | 0.9 | Observed 2026-11-21 · source benchlm:models |
| 72 | [Qwen3.6 Plus](https://modelchoice.dev/models/qwen3-6-plus) | Alibaba | 0.9 | Observed 2026-11-21 · source benchlm:models |
| 74 | [DeepSeek V4 Pro](https://modelchoice.dev/models/deepseek-v4-pro) | DeepSeek | 0.8 | Observed 2026-11-21 · source benchlm:models |
| 74 | [DeepSeek V4 Pro 0813](https://modelchoice.dev/models/deepseek-v4-pro-max) | DeepSeek | 0.8 | Last good 2026-11-18 · source benchlm:models |
| 74 | [MiniMax M2.7](https://modelchoice.dev/models/minimax-m2-7) | MiniMax | 0.8 | Observed 2026-11-21 · source benchlm:models |
| 77 | [LFM3-1.7B](https://modelchoice.dev/models/lfm3-1-7b) | LiquidAI | 0.5 | Observed 2026-11-21 · source benchlm:models |
| 78 | [GLM-5](https://modelchoice.dev/models/glm-5) | Z.AI | 0.3 | Observed 2026-11-21 · source benchlm:models |
| 79 | [GPT-5.6 Terra](https://modelchoice.dev/models/gpt-5-6-terra) | OpenAI | 0.1 | Observed 2026-11-21 · source benchlm:models |
| 80 | [Claude 3.7 Sonnet Thinking](https://modelchoice.dev/models/claude-3-7-sonnet-thinking) | Anthropic | -0.7 | Observed 2026-11-21 · source benchlm:models |
| 81 | [GPT-5.2](https://modelchoice.dev/models/gpt-5-2) | OpenAI | -0.9 | Observed 2026-11-21 · source benchlm:models |
| 82 | [Inkling](https://modelchoice.dev/models/inkling) | Thinking Machines Lab | -1.5 | Observed 2026-11-21 · source benchlm:models |
| 83 | [GPT-5.2-Codex](https://modelchoice.dev/models/gpt-5-2-codex) | OpenAI | -2.2 | Observed 2026-11-21 · source benchlm:models |
| 84 | [Quasar 438B](https://modelchoice.dev/models/quasar-438b) | Multiverse Computing | -2.6 | Last good 2026-10-23 · source benchlm:models |
| 85 | [Command A+](https://modelchoice.dev/models/command-a-plus) | Cohere | -2.7 | Observed 2026-11-21 · source benchlm:models |
| 86 | [Claude Sonnet 4.6](https://modelchoice.dev/models/claude-sonnet-4-6) | Anthropic | -3.5 | Observed 2026-11-21 · source benchlm:models |
| 87 | [Claude Opus 4.5](https://modelchoice.dev/models/claude-opus-4-5) | Anthropic | -4.1 | Observed 2026-11-21 · source benchlm:models |
| 88 | [Gemini 3 Flash](https://modelchoice.dev/models/gemini-3-flash) | Google | -4.3 | Observed 2026-11-21 · source benchlm:models |
| 89 | [Ling 3.0 Flash VL](https://modelchoice.dev/models/ling-3-0-flash-vl) | InclusionAI | -4.5 | Last good 2026-10-23 · source benchlm:models |
| 89 | [MiMo-V2.6-Pro](https://modelchoice.dev/models/mimo-v2-6-pro) | Xiaomi | -4.5 | Observed 2026-11-21 · source benchlm:models |
| 91 | [DeepSeek V4.1 Flash 1017](https://modelchoice.dev/models/deepseek-v4-1-flash) | DeepSeek | -5.3 | Observed 2026-11-21 · source benchlm:models |
| 92 | [MiniMax M3](https://modelchoice.dev/models/minimax-m3) | MiniMax | -5.5 | Observed 2026-11-21 · source benchlm:models |
| 93 | [MiniMax M3.1 Flash](https://modelchoice.dev/models/minimax-m3-1-flash) | MiniMax | -6.4 | Observed 2026-11-21 · source benchlm:models |
| 93 | [Qwen3.8-27B](https://modelchoice.dev/models/qwen3-8-27b) | Alibaba | -6.4 | Observed 2026-11-21 · source benchlm:models |
| 95 | [GPT-5.1-Codex](https://modelchoice.dev/models/gpt-5-1-codex) | OpenAI | -6.5 | Observed 2026-11-21 · source benchlm:models |
| 95 | [GPT-5.1-Codex-Max](https://modelchoice.dev/models/gpt-5-1-codex-max) | OpenAI | -6.5 | Observed 2026-11-21 · source benchlm:models |
| 97 | [Kimi K2.5](https://modelchoice.dev/models/kimi-k2-5) | Moonshot AI | -7.3 | Observed 2026-11-21 · source benchlm:models |
| 97 | [Kimi K2.5 (Reasoning)](https://modelchoice.dev/models/kimi-k2-5-reasoning) | Moonshot AI | -7.3 | Last good 2026-11-18 · source benchlm:models |
| 99 | [A.X K2](https://modelchoice.dev/models/a-x-k2) | SK Telecom | -8.0 | Observed 2026-11-21 · source benchlm:models |
| 100 | [GPT-6 Luna](https://modelchoice.dev/models/gpt-6-luna) | OpenAI | -8.3 | Observed 2026-11-21 · source benchlm:models |
| 101 | [Inkling 2 Mini](https://modelchoice.dev/models/inkling-2-mini) | Thinking Machines Lab | -8.6 | Observed 2026-11-21 · source benchlm:models |
| 102 | [GPT-5](https://modelchoice.dev/models/gpt-5) | OpenAI | -8.7 | Observed 2026-11-21 · source benchlm:models |
| 102 | [GPT-5 (high)](https://modelchoice.dev/models/gpt-5-high) | OpenAI | -8.7 | Last good 2026-11-18 · source benchlm:models |
| 104 | [Claude 4 Sonnet](https://modelchoice.dev/models/claude-4-sonnet) | Anthropic | -9.0 | Observed 2026-11-21 · source benchlm:models |
| 105 | [Inkling-Small](https://modelchoice.dev/models/inkling-small) | Thinking Machines Lab | -9.5 | Observed 2026-11-21 · source benchlm:models |
| 106 | [Claude 3.7 Sonnet](https://modelchoice.dev/models/claude-3-7-sonnet) | Anthropic | -9.7 | Observed 2026-11-21 · source benchlm:models |
| 107 | [Kimi K2.7 Code](https://modelchoice.dev/models/kimi-k2-7-code) | Moonshot AI | -10.2 | Last good 2026-10-23 · source benchlm:models |
| 108 | [GPT-5.6 Luna](https://modelchoice.dev/models/gpt-5-6-luna) | OpenAI | -10.3 | Observed 2026-11-21 · source benchlm:models |
| 109 | [GPT-4o](https://modelchoice.dev/models/gpt-4o) | OpenAI | -10.5 | Observed 2026-11-21 · source benchlm:models |
| 110 | [MiMo-V2.6-Flash](https://modelchoice.dev/models/mimo-v2-6-flash) | Xiaomi | -10.8 | Observed 2026-11-21 · source benchlm:models |
| 111 | [GPT-5 (medium)](https://modelchoice.dev/models/gpt-5-medium) | OpenAI | -10.9 | Last good 2026-11-18 · source benchlm:models |
| 112 | [o1](https://modelchoice.dev/models/o1) | OpenAI | -11.0 | Observed 2026-11-21 · source benchlm:models |
| 113 | [K-EXAONE 2.0](https://modelchoice.dev/models/k-exaone-2-0) | LG AI Research | -11.5 | Observed 2026-11-21 · source benchlm:models |
| 114 | [MiniCPM5-2B](https://modelchoice.dev/models/minicpm5-2b) | OpenBMB | -11.6 | Last good 2026-10-23 · source benchlm:models |
| 115 | [Qwen3.8-Flash-Next](https://modelchoice.dev/models/qwen3-8-flash-next) | Alibaba | -12.2 | Observed 2026-11-21 · source benchlm:models |
| 116 | [Granite 4.2 30B](https://modelchoice.dev/models/granite-4-2-30b) | IBM | -12.4 | Observed 2026-11-21 · source benchlm:models |
| 117 | [DeepSeek V4 Flash 0731](https://modelchoice.dev/models/deepseek-v4-flash-max) | DeepSeek | -14.3 | Observed 2026-11-21 · source benchlm:models |
| 118 | [o3](https://modelchoice.dev/models/o3) | OpenAI | -15.5 | Last good 2026-10-23 · source benchlm:models |
| 119 | [Nemotron 3.5 Lightning 30B A3B NVFP4](https://modelchoice.dev/models/nemotron-3-5-lightning-30b-a3b-nvfp4) | NVIDIA | -15.7 | Observed 2026-11-21 · source benchlm:models |
| 120 | [Ling 3.0 Tiny](https://modelchoice.dev/models/ling-3-0-tiny) | InclusionAI | -15.9 | Observed 2026-11-21 · source benchlm:models |
| 121 | [Gemini 2.5 Pro](https://modelchoice.dev/models/gemini-2-5-pro) | Google | -16.3 | Observed 2026-11-21 · source benchlm:models |
| 122 | [GLM-5-Turbo](https://modelchoice.dev/models/glm-5-turbo) | Z.AI | -16.4 | Observed 2026-11-21 · source benchlm:models |
| 123 | [Granite 4.2 8B](https://modelchoice.dev/models/granite-4-2-8b) | IBM | -16.7 | Observed 2026-11-21 · source benchlm:models |
| 124 | [Llama 3.1 405B](https://modelchoice.dev/models/llama-3-1-405b) | Meta | -17.1 | Last good 2026-10-23 · source benchlm:models |
| 125 | [Ling 3.0 Flash](https://modelchoice.dev/models/ling-3-0-flash) | InclusionAI | -17.9 | Observed 2026-11-21 · source benchlm:models |
| 125 | [Ling 3.0 Flash FP8](https://modelchoice.dev/models/ling-3-0-flash-fp8) | InclusionAI | -17.9 | Last good 2026-10-08 · source benchlm:models |
| 127 | [Granite 4.2 3B](https://modelchoice.dev/models/granite-4-2-3b) | IBM | -18.3 | Observed 2026-11-21 · source benchlm:models |
| 128 | [Hy3](https://modelchoice.dev/models/hy3) | Tencent | -18.5 | Last good 2026-10-23 · source benchlm:models |
| 128 | [Hy3 Preview](https://modelchoice.dev/models/hy3-preview) | Tencent | -18.5 | Last good 2026-10-23 · source benchlm:models |
| 130 | [GPT-5.4 mini](https://modelchoice.dev/models/gpt-5-4-mini) | OpenAI | -18.9 | Observed 2026-11-21 · source benchlm:models |
| 131 | [Nemotron 3.5 Bolt 74B-A9B](https://modelchoice.dev/models/nemotron-3-5-bolt-74b-a9b) | NVIDIA | -19.2 | Last good 2026-10-23 · source benchlm:models |
| 132 | [GLM-5V-Turbo](https://modelchoice.dev/models/glm-5v-turbo) | Z.AI | -19.3 | Observed 2026-11-21 · source benchlm:models |
| 133 | [Qwen3.6-27B](https://modelchoice.dev/models/qwen3-6-27b) | Alibaba | -20.0 | Observed 2026-11-21 · source benchlm:models |
| 134 | [MiMo-V2-Omni](https://modelchoice.dev/models/mimo-v2-omni) | Xiaomi | -20.1 | Observed 2026-11-21 · source benchlm:models |
| 135 | [Gemma 4 E4B](https://modelchoice.dev/models/gemma-4-e4b) | Google | -20.7 | Observed 2026-11-21 · source benchlm:models |
| 136 | [Qwen3.6-35B-A3B](https://modelchoice.dev/models/qwen3-6-35b-a3b) | Alibaba | -22.2 | Last good 2026-10-23 · source benchlm:models |
| 137 | [Claude 3.5 Haiku](https://modelchoice.dev/models/claude-3-5-haiku) | Anthropic | -22.5 | Observed 2026-11-21 · source benchlm:models |
| 138 | [Gemma 4 E2B](https://modelchoice.dev/models/gemma-4-e2b) | Google | -23.6 | Last good 2026-10-23 · source benchlm:models |
| 139 | [LFM2.5-24B-A2B](https://modelchoice.dev/models/lfm2-5-24b-a2b) | LiquidAI | -24.9 | Observed 2026-11-21 · source benchlm:models |
| 140 | [Magistral Medium](https://modelchoice.dev/models/magistral-medium) | Mistral | -26.9 | Observed 2026-11-21 · source benchlm:models |
| 141 | [DeepSeek-R1](https://modelchoice.dev/models/deepseek-r1) | DeepSeek | -27.4 | Observed 2026-11-21 · source benchlm:models |
| 142 | [Apodex 1.1](https://modelchoice.dev/models/apodex-1-1) | Apodex | -27.9 | Observed 2026-11-21 · source benchlm:models |
| 142 | [Apodex 1.1 Mini](https://modelchoice.dev/models/apodex-1-1-mini) | Apodex | -27.9 | Observed 2026-11-21 · source benchlm:models |
| 144 | [Kimi K2](https://modelchoice.dev/models/kimi-k2) | Moonshot AI | -28.3 | Observed 2026-11-21 · source benchlm:models |
| 145 | [GPT-5.4 nano](https://modelchoice.dev/models/gpt-5-4-nano) | OpenAI | -29.5 | Observed 2026-11-21 · source benchlm:models |
| 145 | [LFM2.5-2.6B](https://modelchoice.dev/models/lfm2-5-2-6b) | LiquidAI | -29.5 | Observed 2026-11-21 · source benchlm:models |
| 147 | [DeepSeek V3.1 (Reasoning)](https://modelchoice.dev/models/deepseek-v3-1-reasoning) | DeepSeek | -29.6 | Last good 2026-11-18 · source benchlm:models |
| 148 | [Grok 4 Fast (Reasoning)](https://modelchoice.dev/models/grok-4-fast-reasoning) | xAI | -29.9 | Observed 2026-11-21 · source benchlm:models |
| 148 | [Grok 4.1 Fast (Reasoning)](https://modelchoice.dev/models/grok-4-1-fast-reasoning) | xAI | -29.9 | Observed 2026-11-21 · source benchlm:models |
| 150 | [Mistral Small 4](https://modelchoice.dev/models/mistral-small-4) | Mistral | -31.0 | Observed 2026-11-21 · source benchlm:models |
| 150 | [Mistral Small 4 (Reasoning)](https://modelchoice.dev/models/mistral-small-4-reasoning) | Mistral | -31.0 | Last good 2026-11-18 · source benchlm:models |
| 152 | [Mistral Medium 3](https://modelchoice.dev/models/mistral-medium-3) | Mistral | -31.4 | Observed 2026-11-21 · source benchlm:models |
| 153 | [GLM-4.6](https://modelchoice.dev/models/glm-4-6) | Z.AI | -31.7 | Observed 2026-11-21 · source benchlm:models |
| 154 | [Muse Glimmer 30B](https://modelchoice.dev/models/muse-glimmer-30b) | Meta | -32.2 | Observed 2026-11-21 · source benchlm:models |
| 155 | [LFM2.5-8B-A1B](https://modelchoice.dev/models/lfm2-5-8b-a1b) | LiquidAI | -33.3 | Observed 2026-11-21 · source benchlm:models |
| 156 | [Mistral Large 2](https://modelchoice.dev/models/mistral-large-2) | Mistral | -34.4 | Observed 2026-11-21 · source benchlm:models |
| 157 | [o4-mini](https://modelchoice.dev/models/o4-mini) | OpenAI | -35.7 | Observed 2026-11-21 · source benchlm:models |
| 158 | [GLM-4.7](https://modelchoice.dev/models/glm-4-7) | Z.AI | -36.4 | Observed 2026-11-21 · source benchlm:models |
| 159 | [Grok Code Fast 1](https://modelchoice.dev/models/grok-code-fast-1) | xAI | -37.1 | Observed 2026-11-21 · source benchlm:models |
| 160 | [Step 3.7 Flash](https://modelchoice.dev/models/step-3-7-flash) | StepFun | -37.3 | Observed 2026-11-21 · source benchlm:models |
| 161 | [Qwen3.5 397B](https://modelchoice.dev/models/qwen3-5-397b) | Alibaba | -37.9 | Last good 2026-10-23 · source benchlm:models |
| 161 | [Qwen3.5 397B (Reasoning)](https://modelchoice.dev/models/qwen3-5-397b-reasoning) | Alibaba | -37.9 | Last good 2026-10-23 · source benchlm:models |
| 163 | [Mistral Medium 3.5 128B](https://modelchoice.dev/models/mistral-medium-3-5-128b) | Mistral | -38.7 | Observed 2026-11-21 · source benchlm:models |
| 164 | [Mercury 2.5](https://modelchoice.dev/models/mercury-2-5) | Inception | -39.5 | Last good 2026-10-23 · source benchlm:models |
| 165 | [GPT-4.1](https://modelchoice.dev/models/gpt-4-1) | OpenAI | -39.6 | Observed 2026-11-21 · source benchlm:models |
| 165 | [Mistral Large 3](https://modelchoice.dev/models/mistral-large-3) | Mistral | -39.6 | Observed 2026-11-21 · source benchlm:models |
| 167 | [DeepSeek V3 0324](https://modelchoice.dev/models/deepseek-v3-0324) | DeepSeek | -40.7 | Observed 2026-11-21 · source benchlm:models |
| 168 | [Nemotron 3 Super 100B](https://modelchoice.dev/models/nemotron-3-super-100b) | NVIDIA | -41.5 | Last good 2026-10-08 · source benchlm:models |
| 168 | [Qwen3.5-122B-A10B](https://modelchoice.dev/models/qwen3-5-122b-a10b) | Alibaba | -41.5 | Last good 2026-10-23 · source benchlm:models |
| 170 | [DeepSeek V3](https://modelchoice.dev/models/deepseek-v3) | DeepSeek | -41.6 | Observed 2026-11-21 · source benchlm:models |
| 171 | [Llama 4 Maverick](https://modelchoice.dev/models/llama-4-maverick) | Meta | -41.8 | Last good 2026-10-23 · source benchlm:models |
| 172 | [Gemini 2.0 Flash](https://modelchoice.dev/models/gemini-2-0-flash) | Google | -42.5 | Observed 2026-11-21 · source benchlm:models |
| 173 | [Gemini 2.5 Flash](https://modelchoice.dev/models/gemini-2-5-flash) | Google | -42.6 | Observed 2026-11-21 · source benchlm:models |
| 174 | [DeepSeek V3.1](https://modelchoice.dev/models/deepseek-v3-1) | DeepSeek | -42.7 | Observed 2026-11-21 · source benchlm:models |
| 175 | [Qwen3 Max](https://modelchoice.dev/models/qwen3-max) | Alibaba | -43.5 | Observed 2026-11-21 · source benchlm:models |
| 176 | [Qwen3.5-27B](https://modelchoice.dev/models/qwen3-5-27b) | Alibaba | -44.0 | Observed 2026-11-21 · source benchlm:models |
| 177 | [Trinity-Large-Preview](https://modelchoice.dev/models/trinity-large-preview) | Arcee AI | -44.1 | Last good 2026-10-23 · source benchlm:models |
| 177 | [Trinity-Large-Thinking](https://modelchoice.dev/models/trinity-large-thinking) | Arcee AI | -44.1 | Last good 2026-10-23 · source benchlm:models |
| 179 | [Magistral Small](https://modelchoice.dev/models/magistral-small) | Mistral | -44.4 | Observed 2026-11-21 · source benchlm:models |
| 180 | [Nemotron Ultra 253B](https://modelchoice.dev/models/nemotron-ultra-253b) | NVIDIA | -44.9 | Last good 2026-10-23 · source benchlm:models |
| 181 | [GPT-OSS 120B](https://modelchoice.dev/models/gpt-oss-120b) | OpenAI | -46.4 | Observed 2026-11-21 · source benchlm:models |
| 182 | [DeepSeek V3.2](https://modelchoice.dev/models/deepseek-v3-2) | DeepSeek | -46.9 | Observed 2026-11-21 · source benchlm:models |
| 183 | [Nova Pro](https://modelchoice.dev/models/nova-pro) | Amazon | -47.7 | Observed 2026-11-21 · source benchlm:models |
| 184 | [Qwen3.5-35B-A3B](https://modelchoice.dev/models/qwen3-5-35b-a3b) | Alibaba | -48.1 | Observed 2026-11-21 · source benchlm:models |
| 185 | [MiMo-V2-Flash](https://modelchoice.dev/models/mimo-v2-flash) | Xiaomi | -48.4 | Observed 2026-11-21 · source benchlm:models |
| 186 | [Gemma 4 31B](https://modelchoice.dev/models/gemma-4-31b) | Google | -48.5 | Observed 2026-11-21 · source benchlm:models |
| 187 | [Claude 3 Haiku](https://modelchoice.dev/models/claude-3-haiku) | Anthropic | -48.6 | Observed 2026-11-21 · source benchlm:models |
| 188 | [Llama 3.1 70B](https://modelchoice.dev/models/llama-3-1-70b) | Meta | -49.4 | Last good 2026-10-23 · source benchlm:models |
| 189 | [North Mini Code](https://modelchoice.dev/models/north-mini-code-1-0) | Cohere | -49.8 | Observed 2026-11-21 · source benchlm:models |
| 190 | [Mistral Small 3.1](https://modelchoice.dev/models/mistral-small-3-1) | Mistral | -50.7 | Observed 2026-11-21 · source benchlm:models |
| 191 | [Devstral Small](https://modelchoice.dev/models/devstral-small) | Mistral | -50.8 | Observed 2026-11-21 · source benchlm:models |
| 192 | [Grok 4.1 Fast](https://modelchoice.dev/models/grok-4-1-fast) | xAI | -50.9 | Observed 2026-11-21 · source benchlm:models |
| 193 | [Nemotron 3 Nano 30B](https://modelchoice.dev/models/nemotron-3-nano-30b) | NVIDIA | -51.6 | Last good 2026-10-23 · source benchlm:models |
| 194 | [Gemma 4 26B A4B](https://modelchoice.dev/models/gemma-4-26b-a4b) | Google | -52.0 | Observed 2026-11-21 · source benchlm:models |
| 195 | [Llama 4 Scout](https://modelchoice.dev/models/llama-4-scout) | Meta | -52.1 | Last good 2026-10-23 · source benchlm:models |
| 196 | [Gemma 4 12B](https://modelchoice.dev/models/gemma-4-12b) | Google | -52.3 | Observed 2026-11-21 · source benchlm:models |
| 197 | [Solar Pro 3](https://modelchoice.dev/models/solar-pro-3) | Upstage | -53.4 | Observed 2026-11-21 · source benchlm:models |
| 198 | [GPT-4.1 mini](https://modelchoice.dev/models/gpt-4-1-mini) | OpenAI | -53.6 | Observed 2026-11-21 · source benchlm:models |
| 199 | [Llama 3.3 70B](https://modelchoice.dev/models/llama-3-3-70b) | Meta | -54.2 | Last good 2026-10-23 · source benchlm:models |
| 199 | [Ultravox v0.6 Llama 3.3 70B](https://modelchoice.dev/models/ultravox-v0-6-llama-3-3-70b) | Fixie AI | -54.2 | Last good 2026-10-23 · source benchlm:models |
| 201 | [Phi-4](https://modelchoice.dev/models/phi-4) | Microsoft | -55.7 | Last good 2026-10-23 · source benchlm:models |
| 201 | [Phi-4-reasoning](https://modelchoice.dev/models/phi-4-reasoning) | Microsoft | -55.7 | Last good 2026-10-23 · source benchlm:models |
| 203 | [Nemotron 3 Nano Omni 30B A3B](https://modelchoice.dev/models/nemotron-3-nano-omni-30b-a3b) | NVIDIA | -57.4 | Last good 2026-10-23 · source benchlm:models |
| 204 | [GPT-4.1 nano](https://modelchoice.dev/models/gpt-4-1-nano) | OpenAI | -57.6 | Observed 2026-11-21 · source benchlm:models |
| 205 | [K-Exaone](https://modelchoice.dev/models/k-exaone) | LG AI Research | -58.0 | Observed 2026-11-21 · source benchlm:models |
| 206 | [Gemini 2.5 Flash-Lite](https://modelchoice.dev/models/gemini-2-5-flash-lite) | Google | -58.8 | Observed 2026-11-21 · source benchlm:models |
| 207 | [Sarvam 105B](https://modelchoice.dev/models/sarvam-105b) | Sarvam | -59.4 | Last good 2026-10-23 · source benchlm:models |
| 208 | [Qwen3-Omni-30B-A3B-Thinking](https://modelchoice.dev/models/qwen3-omni-30b-a3b-thinking) | Alibaba | -61.4 | Last good 2026-10-23 · source benchlm:models |
| 209 | [GLM-4.5-Air](https://modelchoice.dev/models/glm-4-5-air) | Z.AI | -61.5 | Observed 2026-11-21 · source benchlm:models |
| 210 | [Solar Pro 2](https://modelchoice.dev/models/solar-pro-2) | Upstage | -62.0 | Observed 2026-11-21 · source benchlm:models |
| 211 | [Exaone 4.0 32B](https://modelchoice.dev/models/exaone-4-0-32b) | LG AI Research | -62.8 | Last good 2026-10-23 · source benchlm:models |
| 212 | [GPT-OSS 20B](https://modelchoice.dev/models/gpt-oss-20b) | OpenAI | -63.0 | Last good 2026-10-23 · source benchlm:models |
| 213 | [Ling 2.6 Flash](https://modelchoice.dev/models/ling-2-6-flash) | InclusionAI | -66.1 | Observed 2026-11-21 · source benchlm:models |
| 214 | [Gemma 3 27B](https://modelchoice.dev/models/gemma-3-27b) | Google | -67.2 | Observed 2026-11-21 · source benchlm:models |
| 215 | [Granite-4.0-350M](https://modelchoice.dev/models/granite-4-0-350m) | IBM | -69.3 | Last good 2026-10-23 · source benchlm:models |
| 215 | [Qwen3-Omni-30B-A3B-Instruct](https://modelchoice.dev/models/qwen3-omni-30b-a3b-instruct) | Alibaba | -69.3 | Last good 2026-10-23 · source benchlm:models |
| 217 | [Sarvam 30B](https://modelchoice.dev/models/sarvam-30b) | Sarvam | -71.5 | Last good 2026-10-23 · source benchlm:models |
| 218 | [Celeris-1](https://modelchoice.dev/models/celeris-1) | Celeris | -71.6 | Last good 2026-10-23 · source benchlm:models |
| 219 | [Granite-4.0-H-1B](https://modelchoice.dev/models/granite-4-0-h-1b) | IBM | -72.3 | Last good 2026-10-23 · source benchlm:models |
| 220 | [Granite-4.0-H-350M](https://modelchoice.dev/models/granite-4-0-h-350m) | IBM | -80.9 | Last good 2026-10-23 · source benchlm:models |
| 221 | [Granite-4.0-1B](https://modelchoice.dev/models/granite-4-0-1b) | IBM | -81.6 | Last good 2026-09-18 · source benchlm:models |
| 222 | [Exaone 4.0 1.2B](https://modelchoice.dev/models/exaone-4-0-1-2b) | LG AI Research | -82.1 | Last good 2026-10-23 · source benchlm:models |
| 223 | [LFM2.5-VL-1.6B-Extract](https://modelchoice.dev/models/lfm2-5-vl-1-6b-extract) | LiquidAI | -84.4 | Last good 2026-10-23 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
