# PMPP-Hard leaderboard

external benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/external-pmpp-hard-auc

PMPP-Hard GPU kernel optimization (AUC, 0-10 hours). Every model the catalog carries a published PMPP-Hard value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | external |
| Measure | Area under the mean tasks-solved curve over 10 hours (task-hours, max 690) |
| Tasks | 69 hard GPU kernel-optimization tasks |
| Difficulty | Long-horizon GPU kernel optimization |
| Published by | [Introducing Inkling 2 Small](https://thinkingmachines.ai/news/inkling-2-small/) |

An agentic GPU kernel-optimization benchmark of 69 hard tasks, adapted by Thinking Machines Lab for consistent cross-model evaluation. Each model gets four independent attempts with a 10-hour budget, and the score is the area under the mean tasks-solved curve, out of a maximum of 690 task-hours.

## PMPP-Hard ranking

2 models with a published PMPP-Hard value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Area under the mean tasks-solved curve over 10 hours (task-hours, max 690) | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Inkling 2 Small](https://modelchoice.dev/models/inkling-2-small) | Thinking Machines Lab | 494.27 | Observed 2026-11-21 · source benchlm:models |
| 2 | [Inkling 2 Mini](https://modelchoice.dev/models/inkling-2-mini) | Thinking Machines Lab | 455.82 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
