# SEAL Math leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/external-scale-math

Scale Labs SEAL Math. Every model the catalog carries a published SEAL Math value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Accuracy (%) |
| Tasks | About 1,000 problems (GSM1k) |
| Difficulty | External agent and model evaluation |
| Published by | [Scale Labs leaderboard](https://labs.scale.com/leaderboard/math) |

Scale’s SEAL math board on GSM1k, a new set of grade-school word problems written to mirror GSM8K without its contamination. BenchLM shows it as display-only reference data, excluded from rankings. Scale marked this board deprecated as of January 2025 and no longer adds models.

## SEAL Math ranking

No model in the catalog has a published SEAL Math score. The benchmark is defined by Scale Labs leaderboard, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
