# Grok 3 [Beta]

xAI · Proprietary · rank 167 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/models/grok-3-beta  
JSON: https://modelchoice.dev/api/model/grok-3-beta

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `grok-3-beta` | — |
| Overall score | 38.5 | Observed 2026-11-21 · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 52 | Observed 2026-11-21 · source benchlm:models |
| Context window | 128K tokens | Observed 2026-11-21 · source benchlm:models |
| Release date | 2025-02-19 | Observed 2026-11-21 · source benchlm:models |
| Access type | Proprietary | — |
| Blended $/1M (75% input / 25% output) | Unavailable | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Coding | 26.8 | Observed 2026-11-21 · source benchlm:models | 26.7 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | 72.1 | Observed 2026-11-21 · source benchlm:models | 72.2 | Observed 2026-11-21 · source benchlm:models |
| Reasoning | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Multimodal & Grounded | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Instruction Following | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Math | 26.8 | Last good 2026-10-08 · source benchlm:models | 26.8 | Last good 2026-10-08 · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |
| Throughput | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Output / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache read / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache write / 1M tokens | Unavailable | Unavailable · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | Unavailable | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Pricing note.** xAI's launch materials refer to `grok-beta`, but we did not find a first-party public token-pricing row for the exact `grok-3-beta` SKU.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | Unavailable |
| Modelled tokens | Unavailable |
| Reason | The applicable input rate is unavailable. |

## Benchmark record

7 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GPQA (Graduate-Level Google-Proof Q&A) | 75.4 | 448 questions | Graduate level | [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://arxiv.org/abs/2311.12022) |
| MMLU-Pro (Massive Multitask Language Understanding Professional) | 79.9 | Multiple subjects | Professional level | [MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark](https://arxiv.org/abs/2406.01574) |
| SimpleQA (Measuring Short-Form Factuality in Large Language Models) | 43.6 | Factual questions | Factual accuracy focused | [Measuring short-form factuality in large language models](https://arxiv.org/abs/2411.04368) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| LiveCodeBench (LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code) | 57 | Continuously updated contest problems | Competitive programming level | [LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code](https://arxiv.org/abs/2403.07974) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AIME 2024 (American Invitational Mathematics Examination 2024) | 52.2 | 15 problems | High school olympiad level | [American Invitational Mathematics Examination](https://www.maa.org/math-competitions/aime) |
| FrontierMath v2 (Tiers 1-3) (FrontierMath v2 Tiers 1-3) | 3.793 | 285 private advanced mathematics problems | From olympiad-plus to early research mathematics | [FrontierMath v2 benchmark hub](https://epoch.ai/benchmarks/frontiermath-tiers-1-3-v2) |
| FrontierMath v2 (Tier 4) (FrontierMath v2 Tier 4) | 0.000 | 41 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | [FrontierMath Tier 4 v2 leaderboard](https://epoch.ai/benchmarks/frontiermath-tier-4-v2?view=graph&tab=leaderboard) |

## Independent scores (Epoch AI)

A second, independent score source: Epoch's own figures in Epoch's units, one line per model version Epoch evaluated (effort setting as Epoch labels it); higher is better. Not part of this site's capability scores or rank.

| Benchmark | Variant | Score | Unit | Epoch date | Evidence |
| --- | --- | --- | --- | --- | --- |
| GPQA Diamond | default | 0.6758 | fraction (0–1) | 2025-05-26 | Observed 2026-11-21 · source epoch:benchmarks |
| Aider polyglot | default (diff) | 53.3% | percent | 2025-04-10 | Observed 2026-11-21 · source epoch:benchmarks |

Source: [Epoch AI, CC BY 4.0](https://epoch.ai/benchmarks) ([licence](https://creativecommons.org/licenses/by/4.0/)). Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks.

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 05:17 UTC.
