# OpenHarmony Bench v1.0 leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelchoice.dev/leaderboards/benchmarks/coding-open-harmony-bench

Every model the catalog carries a published OpenHarmony Bench v1.0 value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Task completion through DevEco Code |
| Tasks | 153 app-development and bug-fix tasks |
| Difficulty | End-to-end OpenHarmony application development |
| Published by | [OpenHarmony Bench: Evaluating LLMs and Coding Agents on OpenHarmony App Development](https://arxiv.org/abs/2608.16022) |

An app-level coding benchmark that asks DevEco Code configurations to implement observable behavior in buildable OpenHarmony ArkTS applications. Replaced by OpenHarmony Bench v1.2 in November 2026.

## OpenHarmony Bench v1.0 ranking

14 models with a published OpenHarmony Bench v1.0 value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Task completion through DevEco Code | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [GLM-5.3](https://modelchoice.dev/models/glm-5-3) | Z.AI | 60.8 | Observed 2026-11-21 · source benchlm:models |
| 1 | [Qwen3.8 Max](https://modelchoice.dev/models/qwen3-8-max) | Alibaba | 60.8 | Observed 2026-11-21 · source benchlm:models |
| 3 | [DeepSeek V4.1 Flash 1017](https://modelchoice.dev/models/deepseek-v4-1-flash) | DeepSeek | 60.3 | Observed 2026-11-21 · source benchlm:models |
| 4 | [DeepSeek V4 Pro](https://modelchoice.dev/models/deepseek-v4-pro) | DeepSeek | 59.0 | Observed 2026-11-21 · source benchlm:models |
| 4 | [DeepSeek V4 Pro 0813](https://modelchoice.dev/models/deepseek-v4-pro-max) | DeepSeek | 59.0 | Last good 2026-11-18 · source benchlm:models |
| 6 | [GLM-5.2](https://modelchoice.dev/models/glm-5-2) | Z.AI | 58.4 | Observed 2026-11-21 · source benchlm:models |
| 7 | [GLM-5.3-Flash](https://modelchoice.dev/models/glm-5-3-flash) | Z.AI | 57.3 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Kimi K3](https://modelchoice.dev/models/kimi-3) | Moonshot AI | 57.3 | Observed 2026-11-21 · source benchlm:models |
| 9 | [Qwen3.8 Max Preview](https://modelchoice.dev/models/qwen3-8-max-preview) | Alibaba | 56.0 | Observed 2026-11-21 · source benchlm:models |
| 10 | [DeepSeek V4 Flash 0731](https://modelchoice.dev/models/deepseek-v4-flash-max) | DeepSeek | 53.8 | Observed 2026-11-21 · source benchlm:models |
| 11 | [Qwen3.7 Max](https://modelchoice.dev/models/qwen3-7-max) | Alibaba | 53.4 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GLM-5.1](https://modelchoice.dev/models/glm-5-1) | Z.AI | 52.3 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Kimi K2.7 Code](https://modelchoice.dev/models/kimi-k2-7-code) | Moonshot AI | 52.1 | Observed 2026-11-21 · source benchlm:models |
| 14 | [MiniMax M3](https://modelchoice.dev/models/minimax-m3) | MiniMax | 48.4 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
