# SimpleVQA leaderboard

Multimodal & Grounded benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/multimodal-grounded-simple-vqa

Every model the catalog carries a published SimpleVQA value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Multimodal & Grounded |
| Measure | Image-grounded question answering |
| Tasks | Visual QA tasks |
| Difficulty | General visual understanding |
| Published by | [GLM-5V-Turbo](https://docs.z.ai/guides/vlm/glm-5v-turbo) |

A visual question answering benchmark focused on straightforward image-grounded understanding.

## SimpleVQA ranking

18 models with a published SimpleVQA value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Image-grounded question answering | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Qwen3.7 Plus](https://modelchoice.dev/models/qwen3-7-plus) | Alibaba | 81.7 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Step 3.7 Flash](https://modelchoice.dev/models/step-3-7-flash) | StepFun | 79.2 | Observed 2026-11-21 · source benchlm:models |
| 3 | [Qwen3.8 Max](https://modelchoice.dev/models/qwen3-8-max) | Alibaba | 75.0 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Muse Spark Open](https://modelchoice.dev/models/muse-spark-open) | Meta | 73.6 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Gemini 3 Pro](https://modelchoice.dev/models/gemini-3-pro) | Google | 73.2 | Observed 2026-11-21 · source benchlm:models |
| 6 | [dots3-note Preview](https://modelchoice.dev/models/dots3-note-preview) | Dots Studio | 72.5 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Gemini 3.1 Pro](https://modelchoice.dev/models/gemini-3-1-pro) | Google | 72.4 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Muse Spark](https://modelchoice.dev/models/muse-spark) | Meta | 71.3 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Kimi K2.5](https://modelchoice.dev/models/kimi-k2-5) | Moonshot AI | 71.2 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Qwen3.5 397B](https://modelchoice.dev/models/qwen3-5-397b) | Alibaba | 67.1 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Claude Opus 4.5](https://modelchoice.dev/models/claude-opus-4-5) | Anthropic | 65.7 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GPT-5.4](https://modelchoice.dev/models/gpt-5-4) | OpenAI | 61.1 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Qwen3.6-35B-A3B](https://modelchoice.dev/models/qwen3-6-35b-a3b) | Alibaba | 58.9 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Grok 4.20](https://modelchoice.dev/models/grok-4-20-beta) | xAI | 57.4 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Qwen3.6-27B](https://modelchoice.dev/models/qwen3-6-27b) | Alibaba | 56.1 | Observed 2026-11-21 · source benchlm:models |
| 16 | [GPT-5.2](https://modelchoice.dev/models/gpt-5-2) | OpenAI | 55.8 | Observed 2026-11-21 · source benchlm:models |
| 17 | [LFM3-VL-2B](https://modelchoice.dev/models/lfm3-vl-2b) | LiquidAI | 36.3 | Observed 2026-11-21 · source benchlm:models |
| 18 | [LFM2.5-VL-3B](https://modelchoice.dev/models/lfm2-5-vl-3b) | LiquidAI | 35.4 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
