# SimpleQA leaderboard

Knowledge benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/knowledge-simple-qa

Measuring Short-Form Factuality in Large Language Models. Every model the catalog carries a published SimpleQA value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Knowledge |
| Measure | Short-form Q&A |
| Tasks | Factual questions |
| Difficulty | Factual accuracy focused |
| Published by | [Measuring short-form factuality in large language models](https://arxiv.org/abs/2411.04368) |

A benchmark that evaluates the ability of language models to answer short, fact-seeking questions accurately. Focuses on factual correctness rather than reasoning complexity.

## SimpleQA ranking

18 models with a published SimpleQA value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Short-form Q&A | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [GPT-4.5](https://modelchoice.dev/models/gpt-4-5) | OpenAI | 62.5 | Observed 2026-11-21 · source benchlm:models |
| 2 | [DeepSeek V4 Pro 0813](https://modelchoice.dev/models/deepseek-v4-pro-max) | DeepSeek | 57.9 | Last good 2026-10-08 · source benchlm:models |
| 3 | [Qwen3 235B 2507](https://modelchoice.dev/models/qwen3-235b-2507) | Alibaba | 54.3 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Grok 3 [Beta]](https://modelchoice.dev/models/grok-3-beta) | xAI | 43.6 | Observed 2026-11-21 · source benchlm:models |
| 5 | [DeepSeek V4 Flash 0731](https://modelchoice.dev/models/deepseek-v4-flash-max) | DeepSeek | 34.1 | Last good 2026-10-08 · source benchlm:models |
| 6 | [Kimi K2](https://modelchoice.dev/models/kimi-k2) | Moonshot AI | 31 | Observed 2026-11-21 · source benchlm:models |
| 6 | [MAI-Thinking-1](https://modelchoice.dev/models/mai-thinking-1) | Microsoft | 31 | Last good 2026-10-08 · source benchlm:models |
| 8 | [DeepSeek-R1](https://modelchoice.dev/models/deepseek-r1) | DeepSeek | 30.1 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Gemini 2.0 Flash](https://modelchoice.dev/models/gemini-2-0-flash) | Google | 29.9 | Observed 2026-11-21 · source benchlm:models |
| 10 | [DeepSeek-R1-0528](https://modelchoice.dev/models/deepseek-r1-0528) | DeepSeek | 27.8 | Observed 2026-11-21 · source benchlm:models |
| 11 | [DeepSeek V3](https://modelchoice.dev/models/deepseek-v3) | DeepSeek | 24.9 | Observed 2026-11-21 · source benchlm:models |
| 12 | [MiniMax-Text-01](https://modelchoice.dev/models/minimax-text-01) | MiniMax | 23.7 | Observed 2026-11-21 · source benchlm:models |
| 13 | [o4-mini](https://modelchoice.dev/models/o4-mini) | OpenAI | 20.2 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Gemini 2.0 Flash-Lite](https://modelchoice.dev/models/gemini-2-0-flash-lite) | Google | 16.5 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Gemini 2.5 Flash-Lite](https://modelchoice.dev/models/gemini-2-5-flash-lite) | Google | 10.7 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Mistral Small 3.1](https://modelchoice.dev/models/mistral-small-3-1) | Mistral | 10.43 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Gemini 1.5 Flash](https://modelchoice.dev/models/gemini-1-5-flash) | Google | 8.6 | Observed 2026-11-21 · source benchlm:models |
| 18 | [o1-mini](https://modelchoice.dev/models/o1-mini) | OpenAI | 7.6 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
