# ParseBench-1 leaderboard

Multimodal & Grounded benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/multimodal-grounded-parse-bench-llama-index

ParseBench-1: document parsing for AI agents (LlamaIndex leaderboard, first release). Every model the catalog carries a published ParseBench-1 value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Multimodal & Grounded |
| Measure | Deterministic test rules per page; five dimension scores and their mean, in percent |
| Tasks | 2,078 human-verified enterprise pages from insurance, finance and government documents |
| Difficulty | No method is strong on all five dimensions; charts and visual grounding separate the field |
| Published by | [ParseBench: A Document Parsing Benchmark for AI Agents](https://arxiv.org/abs/2604.08538) |

The first ParseBench release: scores document parsers and vision-language models on 2,078 human-verified enterprise pages across tables, charts, content faithfulness, semantic formatting and visual grounding, with the listed cost per page. ParseBench-2 is a separate benchmark with different scoring.

## ParseBench-1 ranking

40 models with a published ParseBench-1 value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Deterministic test rules per page; five dimension scores and their mean, in percent | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Claude Opus 5.5](https://modelchoice.dev/models/claude-opus-5-5) | Anthropic | 78.80 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Claude Fable 5.1](https://modelchoice.dev/models/claude-fable-5-1) | Anthropic | 77.81 | Observed 2026-11-21 · source benchlm:models |
| 3 | [GPT-5.6 Sol](https://modelchoice.dev/models/gpt-5-6-sol) | OpenAI | 74.40 | Observed 2026-11-21 · source benchlm:models |
| 4 | [Gemini 3 Flash](https://modelchoice.dev/models/gemini-3-flash) | Google | 74.07 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Hy4](https://modelchoice.dev/models/hy4) | Tencent | 73.72 | Observed 2026-11-21 · source benchlm:models |
| 6 | [GPT-6.1 Terra](https://modelchoice.dev/models/gpt-6-1-terra) | OpenAI | 73.64 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Gemini 3.5 Flash](https://modelchoice.dev/models/gemini-3-5-flash) | Google | 73.22 | Observed 2026-11-21 · source benchlm:models |
| 8 | [Gemini 3.8 Flash](https://modelchoice.dev/models/gemini-3-8-flash) | Google | 71.20 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Gemini 3.7 Flash](https://modelchoice.dev/models/gemini-3-7-flash) | Google | 70.37 | Observed 2026-11-21 · source benchlm:models |
| 10 | [GPT-6 Astra](https://modelchoice.dev/models/gpt-6-astra) | OpenAI | 69.81 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Claude Fable 5](https://modelchoice.dev/models/claude-fable-5) | Anthropic | 69.79 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GPT-6.1 Sol](https://modelchoice.dev/models/gpt-6-1-sol) | OpenAI | 69.63 | Observed 2026-11-21 · source benchlm:models |
| 13 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 69.36 | Observed 2026-11-21 · source benchlm:models |
| 14 | [Claude Sonnet 5.5](https://modelchoice.dev/models/claude-sonnet-5-5) | Anthropic | 69.21 | Observed 2026-11-21 · source benchlm:models |
| 15 | [Gemini 3.6 Flash](https://modelchoice.dev/models/gemini-3-6-flash) | Google | 69.12 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Qwen3.8-27B](https://modelchoice.dev/models/qwen3-8-27b) | Alibaba | 69.03 | Observed 2026-11-21 · source benchlm:models |
| 17 | [GPT-6 Sol](https://modelchoice.dev/models/gpt-6-sol) | OpenAI | 68.85 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Gemini 3.1 Pro](https://modelchoice.dev/models/gemini-3-1-pro) | Google | 67.32 | Observed 2026-11-21 · source benchlm:models |
| 19 | [GPT-5.6 Terra](https://modelchoice.dev/models/gpt-5-6-terra) | OpenAI | 67.06 | Observed 2026-11-21 · source benchlm:models |
| 20 | [GPT-5.6 Luna](https://modelchoice.dev/models/gpt-5-6-luna) | OpenAI | 66.86 | Observed 2026-11-21 · source benchlm:models |
| 21 | [GPT-5.5](https://modelchoice.dev/models/gpt-5-5) | OpenAI | 66.42 | Observed 2026-11-21 · source benchlm:models |
| 22 | [DeepSeek V4.1 Flash 1017](https://modelchoice.dev/models/deepseek-v4-1-flash) | DeepSeek | 64.38 | Observed 2026-11-21 · source benchlm:models |
| 23 | [GPT-6 Luna](https://modelchoice.dev/models/gpt-6-luna) | OpenAI | 64.13 | Observed 2026-11-21 · source benchlm:models |
| 24 | [Claude Opus 4.7](https://modelchoice.dev/models/claude-opus-4-7) | Anthropic | 63.34 | Observed 2026-11-21 · source benchlm:models |
| 25 | [Gemma 4 31B](https://modelchoice.dev/models/gemma-4-31b) | Google | 62.40 | Observed 2026-11-21 · source benchlm:models |
| 26 | [Claude Opus 4.8](https://modelchoice.dev/models/claude-opus-4-8) | Anthropic | 62.27 | Observed 2026-11-21 · source benchlm:models |
| 27 | [GPT-5.4](https://modelchoice.dev/models/gpt-5-4) | OpenAI | 61.72 | Observed 2026-11-21 · source benchlm:models |
| 28 | [Claude Sonnet 5](https://modelchoice.dev/models/claude-sonnet-5) | Anthropic | 61.16 | Observed 2026-11-21 · source benchlm:models |
| 29 | [Gemini 3.5 Flash-Lite](https://modelchoice.dev/models/gemini-3-5-flash-lite) | Google | 59.49 | Observed 2026-11-21 · source benchlm:models |
| 30 | [Gemma 4 26B A4B](https://modelchoice.dev/models/gemma-4-26b-a4b) | Google | 58.50 | Observed 2026-11-21 · source benchlm:models |
| 31 | [Gemini 3.1 Flash-Lite](https://modelchoice.dev/models/gemini-3-1-flash-lite) | Google | 56.66 | Observed 2026-11-21 · source benchlm:models |
| 32 | [Claude Haiku 5.5](https://modelchoice.dev/models/claude-haiku-5-5) | Anthropic | 56.06 | Observed 2026-11-21 · source benchlm:models |
| 33 | [Claude Opus 4.6](https://modelchoice.dev/models/claude-opus-4-6) | Anthropic | 53.80 | Observed 2026-11-21 · source benchlm:models |
| 34 | [Claude Haiku 4.5 Thinking](https://modelchoice.dev/models/claude-haiku-4-5-thinking) | Anthropic | 51.21 | Observed 2026-11-21 · source benchlm:models |
| 35 | [Claude Haiku 4.5](https://modelchoice.dev/models/claude-haiku-4-5) | Anthropic | 49.34 | Observed 2026-11-21 · source benchlm:models |
| 36 | [Nemotron 3 Nano Omni 30B A3B](https://modelchoice.dev/models/nemotron-3-nano-omni-30b-a3b) | NVIDIA | 48.51 | Observed 2026-11-21 · source benchlm:models |
| 37 | [GPT-5.4 nano](https://modelchoice.dev/models/gpt-5-4-nano) | OpenAI | 42.24 | Observed 2026-11-21 · source benchlm:models |
| 38 | [Gemma 4 E4B](https://modelchoice.dev/models/gemma-4-e4b) | Google | 41.13 | Observed 2026-11-21 · source benchlm:models |
| 39 | [Amazon Nova 2 Lite](https://modelchoice.dev/models/nova-2-lite) | Amazon | 40.43 | Observed 2026-11-21 · source benchlm:models |
| 40 | [Qwen3.6-35B-A3B](https://modelchoice.dev/models/qwen3-6-35b-a3b) | Alibaba | 37.35 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
