# GLM-5.1

Z.AI · Open Weight · rank 88 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/models/glm-5-1  
JSON: https://modelchoice.dev/api/model/glm-5-1

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `glm-5-1` | — |
| Overall score | 52.2 | Observed 2026-11-21 · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 63 | Observed 2026-11-21 · source benchlm:models |
| Context window | 203K tokens | Observed 2026-11-21 · source benchlm:models |
| Max output (models.dev) | 131,072 tokens | Observed 2026-11-21 · source modelsdev:catalog |
| Modalities (models.dev) | Input: text · Output: text | Observed 2026-11-21 · source modelsdev:catalog |
| Release date | 2026-04-07 | Observed 2026-11-21 · source benchlm:models |
| Access type | Open Weight | — |
| Blended $/1M (75% input / 25% output) | $2.15 | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | 58.1 | Observed 2026-11-21 · source benchlm:models | 54.4 | Observed 2026-11-21 · source benchlm:models |
| Coding | 59.5 | Observed 2026-11-21 · source benchlm:models | 59.4 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | 50.6 | Observed 2026-11-21 · source benchlm:models | 50.6 | Observed 2026-11-21 · source benchlm:models |
| Reasoning | 74.8 | Observed 2026-11-21 · source benchlm:models | 74.8 | Observed 2026-11-21 · source benchlm:models |
| Multimodal & Grounded | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Instruction Following | 93.5 | Observed 2026-11-21 · source benchlm:models | 93.5 | Observed 2026-11-21 · source benchlm:models |
| Math | 55.3 | Observed 2026-11-21 · source benchlm:models | 55.3 | Observed 2026-11-21 · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | 53.77 s | 2026-11-21 | 2026-11-21 | Observed 2026-11-21 · source benchlm:speed |
| Throughput | 73 tok/s | 2026-11-21 | 2026-11-21 | Observed 2026-11-21 · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | $1.40 | Observed 2026-11-21 · source benchlm:pricing |
| Output / 1M tokens | $4.40 | Observed 2026-11-21 · source benchlm:pricing |
| Cache read / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache write / 1M tokens | Unavailable | Unavailable · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | $2.15 | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Pricing note.** Z.AI's official pricing page lists GLM-5.1 at $1.40 input / $4.40 output per million tokens.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | $6.05 |
| Modelled tokens | 2.82M |

## Benchmark record

48 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GPQA-D (GPQA Diamond) | 86.2 | Graduate-level science questions | Graduate level | [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://arxiv.org/abs/2311.12022) |
| HLE (Humanity's Last Exam) | 31 | Expert-level questions | Frontier expert level | [Humanity's Last Exam](https://lastexam.ai/) |
| Artificial Analysis Intelligence Index | 26.1 | Cross-benchmark intelligence index | Display-only external reference | [Artificial Analysis](https://artificialanalysis.ai/) |
| AA-GPQA Diamond (Artificial Analysis GPQA Diamond) | 86.8 | Graduate-level science questions | Graduate-level science reasoning | [Artificial Analysis GPQA Diamond Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/gpqa-diamond) |
| AA-HLE (Artificial Analysis Humanity's Last Exam) | 30.1 | Expert-level questions | Frontier expert reasoning | [Artificial Analysis Humanity's Last Exam Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/hle) |
| AA-Omniscience Index (Artificial Analysis Omniscience Index) | 0.9 | Knowledge questions | Broad factual knowledge | [AA-Omniscience: Knowledge and Hallucination Benchmark](https://artificialanalysis.ai/evaluations/omniscience) |
| AA-Omniscience Accuracy (Artificial Analysis Omniscience Accuracy) | 23.7 | Knowledge questions | Broad knowledge | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| AA-Omniscience Hallucination Rate (Artificial Analysis Omniscience Hallucination Rate) | 29.9 | Knowledge questions | Factuality | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| GPQA Diamond (Vals) (GPQA Diamond, Vals AI run) | 84.5 | Graduate-level science questions | Expert reasoning | [Vals AI GPQA Diamond, Vals AI run leaderboard](https://www.vals.ai/benchmarks/gpqa) |
| MMLU-Pro (Vals) (MMLU-Pro, Vals AI run) | 86.9 | Academic multiple-choice questions | Broad academic knowledge | [Vals AI MMLU-Pro, Vals AI run leaderboard](https://www.vals.ai/benchmarks/mmlu_pro) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Terminal-Bench 2.0 | 63.5 | Terminal-based software tasks | Professional software engineering | [Terminal-Bench 2.0](https://www.tbench.ai/) |
| SWE-Rebench | 62.7 | Fresh GitHub issues (rolling window) | Professional software engineering | [SWE-Rebench: Contamination-Free Evaluation of Software Engineering Agents](https://swe-rebench.com/) |
| SWE-bench Pro | 58.4 | 1,865 repository problems | Long-horizon professional engineering | [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](https://arxiv.org/abs/2509.16941) |
| OpenHarmony Bench v1.0 | 52.3 | 153 app-development and bug-fix tasks | End-to-end OpenHarmony application development | [OpenHarmony Bench: Evaluating LLMs and Coding Agents on OpenHarmony App Development](https://arxiv.org/abs/2608.16022) |
| Vibe Code Bench (Vibe Code Bench v1.1) | 31.46 | End-to-end web application builds | End-to-end software delivery | [Vibe Code Bench: Evaluating AI Models on End-to-End Web Application Development](https://www.vals.ai/benchmarks/vibe-code) |
| NL2Repo | 42.7 | Natural language to repository tasks | System-level software comprehension | [MiniMax M2.7: Early Echoes of Self-Evolution](https://www.minimax.io/news/minimax-m27-en) |
| AA Coding Index (Artificial Analysis Coding Index) | 55.8 | Cross-benchmark coding index | Display-only external reference | [Artificial Analysis model leaderboards](https://artificialanalysis.ai/leaderboards/models) |
| AA-SciCode (Artificial Analysis SciCode) | 44.8 | Scientific coding subproblems | Scientific programming | [Artificial Analysis SciCode Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/scicode) |
| LiveCodeBench (Vals) (LiveCodeBench, Vals AI run) | 81.4 | Competitive programming problems (easy, medium, hard) | Frontier coding | [Vals AI LiveCodeBench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/lcb) |
| SWE-bench (Vals) (SWE-bench, Vals AI run) | 76.4 | Real repository issues by human time bucket | Frontier coding agents | [Vals AI SWE-bench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/swebench) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AIME26 (AIME 2026) | 95.3 | Competition math problems | Olympiad-style mathematics | [Qwen3.6 launch benchmarks](https://qwen.ai/blog?id=qwen3.6) |
| HMMT Nov 2025 (Harvard-MIT Mathematics Tournament November 2025) | 94.0 | Competition math problems | Olympiad-style mathematics | [Qwen3.6 launch benchmarks](https://qwen.ai/blog?id=qwen3.6) |
| HMMT Feb 2026 (Harvard-MIT Mathematics Tournament February 2026) | 82.6 | Competition math problems | Olympiad-style mathematics | [Qwen3.6 launch benchmarks](https://qwen.ai/blog?id=qwen3.6) |
| MMAnswerBench | 83.8 | Multimodal math questions | Advanced mathematical reasoning | [Qwen3.6 launch benchmarks](https://qwen.ai/blog?id=qwen3.6) |
| FrontierMath v2 (Tiers 1-3) (FrontierMath v2 Tiers 1-3) | 36.842 | 285 private advanced mathematics problems | From olympiad-plus to early research mathematics | [FrontierMath v2 benchmark hub](https://epoch.ai/benchmarks/frontiermath-tiers-1-3-v2) |
| FrontierMath v2 (Tier 4) (FrontierMath v2 Tier 4) | 12.500 | 41 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | [FrontierMath Tier 4 v2 leaderboard](https://epoch.ai/benchmarks/frontiermath-tier-4-v2?view=graph&tab=leaderboard) |

### Reasoning

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-LCR (Artificial Analysis Long Context Reasoning) | 73.7 | Long-context reasoning tasks | Long-context reasoning | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| CritPt (Critical Physics Tasks) | 4.6 | Research-level physics questions | Research-level physics reasoning | [CritPt Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/critpt) |

### Instruction Following

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-IFBench (Artificial Analysis IFBench) | 76.3 | Verifiable instruction constraints | Instruction precision | [Artificial Analysis IFBench Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/ifbench) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA ITBench (Artificial Analysis ITBench-AA) | 40.3 | IT incident-response tasks | Enterprise IT operations | [Artificial Analysis ITBench-AA Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/itbench-aa) |
| Terminal-Bench 2.0 | 63.5 | Terminal-based software tasks | Professional software engineering | [Terminal-Bench 2.0](https://www.tbench.ai/) |
| BrowseComp | 68 | Research questions requiring browsing | Hard web research | [BrowseComp](https://openai.com/index/browsecomp/) |
| HLE w/ tools (Humanity's Last Exam with tools) | 52.3 | Expert questions with tool use | Frontier tool-augmented reasoning | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |
| GDPval-AA | 1181 | Agentic real-world work tasks | Professional agentic workflows | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |
| GDPval-AA (GDPval-AA normalized) | 30.8 | Economically valuable tasks | Professional agentic workflows | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| AA Agentic Index (Artificial Analysis Agentic Index) | 25.2 | Cross-benchmark agentic index | Display-only external reference | [Artificial Analysis model leaderboards](https://artificialanalysis.ai/leaderboards/models) |
| Gert Labs (Gert Labs Composite Game Benchmark) | 60.11 | Novel game environments | Agentic coding and decision-making | [Gert Labs rankings](https://gertlabs.com/rankings) |
| CyberGym | 68.7 | 1,507 vulnerability analysis instances | Real-world cybersecurity | [CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale](https://www.cybergym.io/) |
| MCP Atlas | 71.8 | Tool-integrated agent tasks | Advanced tool use | [Introducing GPT-5.4 mini and nano](https://openai.com/index/introducing-gpt-5-4-mini-and-nano/) |
| τ²-bench results (τ²-Bench Tool-Agent-User Evaluation) | 97.7 | Airline, retail, and telecom customer-service task sets | Dual-control customer-service workflows | [τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment](https://arxiv.org/abs/2506.07982) |
| Claw-Eval | 62.3 | 300 tasks, 2,159 rubrics | Real-world general, multi-turn, and native multimodal agent execution | [Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents](https://arxiv.org/abs/2604.06132) |
| ResearchClawBench | 18.2 | 40 tasks across 10 scientific domains | Scientific research re-discovery | [ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research](https://arxiv.org/abs/2606.07591) |
| τ³-bench results (τ³-Bench Tool-Agent-User Evaluation) | 70.6 | Corrected customer-service tasks plus knowledge and voice evaluation modes | Long-horizon, multimodal, and knowledge-aware tool use | [Official τ³-bench repository and release notes](https://github.com/sierra-research/tau2-bench) |
| Terminal-Bench 2.1 (Vals) (Terminal-Bench 2.1, Vals AI run) | 56.9 | Difficult terminal tasks | Frontier agentic | [Vals AI Terminal-Bench 2.1, Vals AI run leaderboard](https://www.vals.ai/benchmarks/terminal-bench-2-1) |

### Multimodal & Grounded

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Design Arena Website (Design Arena Website Elo) | 1290 | Website generation comparisons | Design and website generation | [OpenRouter Grok 4.3 benchmarks](https://openrouter.ai/x-ai/grok-4.3/benchmarks) |

### external

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Chess Puzzles (Chess Puzzles (Epoch AI)) | 20.0 | 100 programmatically generated chess positions with a single best move | Novel chess positions, single best move | [Chess Puzzles (Epoch AI)](https://epoch.ai/benchmarks/chess-puzzles) |
| NYT Connections (NYT Connections LLM Benchmark (extended version)) | 77.7 | 940 NYT Connections puzzles, each with up to four added trick words | Wordplay, word knowledge and decoys that fit almost-but-not-quite | [NYT Connections LLM Benchmark (Lech Mazur, GitHub)](https://github.com/lechmazur/nyt-connections) |
| SkillsBench official leaderboard (BenchFlow) (SkillsBench v1.1 official leaderboard (BenchFlow)) | 58.4 | 87 tasks in 8 domains (SkillsBench v1.1) | Multi-step agent tasks | [SkillsBench leaderboard](https://www.skillsbench.ai/leaderboard) |

## Independent scores (Epoch AI)

A second, independent score source: Epoch's own figures in Epoch's units, one line per model version Epoch evaluated (effort setting as Epoch labels it); higher is better. Not part of this site's capability scores or rank.

| Benchmark | Variant | Score | Unit | Epoch date | Evidence |
| --- | --- | --- | --- | --- | --- |
| GPQA Diamond | default | 0.899 | fraction (0–1) | 2026-08-10 | Observed 2026-11-21 · source epoch:benchmarks |
| FrontierMath Tiers 1-3 (v2) | default | 0.3684 | fraction (0–1) | 2026-08-29 | Observed 2026-11-21 · source epoch:benchmarks |
| FrontierMath Tiers 1-3 (v2) | none | 0.2491 | fraction (0–1) | 2026-08-28 | Observed 2026-11-21 · source epoch:benchmarks |
| SWE-bench Verified | default | 0.7417 | fraction (0–1) | 2026-05-15 | Observed 2026-11-21 · source epoch:benchmarks |
| SimpleQA Verified | default | 0.34 | fraction (0–1) | 2026-08-27 | Observed 2026-11-21 · source epoch:benchmarks |

Source: [Epoch AI, CC BY 4.0](https://epoch.ai/benchmarks) ([licence](https://creativecommons.org/licenses/by/4.0/)). Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks.

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 05:17 UTC.
