NewsNew models, Next Concept Models and AI agents · coming soonThe VerdictHead-to-head tests you can rerun on LMArena · coming soonFuture with AIEssays on where AI is going · coming soonEverything in Read →
Coming soonThe first News, Verdicts and essays are on the way.Get them first in AI into Production, our weekly newsletter.
Learn
Practical guides to using AI models well
GuidesHow-to pieces on cost, routing and usage · coming soonLLM glossaryPlain definitions of the terms we use · coming soonBYOK 101Using your own API keys, safely · coming soonProvider and lab reviewsWhere to run each model, and what it costs · coming soon
LanguageTranslate this page
Preferred languages
More languages supported by Google Translate
Open the selector to load the current language catalog.
NewsNew models, Next Concept Models and AI agents · coming soonThe VerdictHead-to-head tests you can rerun on LMArena · coming soonFuture with AIEssays on where AI is going · coming soonEverything in Read →
Coming soonThe first News, Verdicts and essays are on the way.Get them first in AI into Production, our weekly newsletter.
Learn
Practical guides to using AI models well
Guides7How-to pieces on cost, routing and usageLLM glossaryPlain definitions of the terms we use · coming soonBYOK 101Using your own API keys, safely · coming soonProvider and lab reviewsWhere to run each model, and what it costs · coming soon
Open the selector to load the current language catalog.
Translations are provided by Google Translate.
ModelChoiceby MonoMind AI Lab
external benchmark
NYT Connections leaderboard
NYT Connections LLM Benchmark (extended version). Every model the catalog carries a published NYT Connections value for, ranked by that value.
Printed
Page
https://modelchoice.dev
external benchmark
NYT Connections leaderboard
NYT Connections LLM Benchmark (extended version). Every model the catalog carries a published NYT Connections value for, ranked by that value.
About this benchmark
Lech Mazur's NYT Connections benchmark gives a model 940 puzzles from the New York Times word game, each with up to four extra trick words, and asks it to sort the words into four groups of four in one try. It tests word knowledge, wordplay and resisting plausible decoys. 94 models in the ModelChoice catalog have a published value.
When it's a good referenceUse it to compare wordplay and resistance to plausible decoys in one try with no feedback. It is a puzzle, so it is indirect evidence for writing tasks.
Categoryexternal
MeasureSort 16 to 20 words into four groups of four, one attempt per puzzle, no feedback
Tasks940 NYT Connections puzzles, each with up to four added trick words
DifficultyWordplay, word knowledge and decoys that fit almost-but-not-quite
FrontierThe highest score on this leaderboard.Gemini 4 Carbon99.3 on NYT Connections. 0.7 points above #2.
Daily driverThe cheapest best-value model scoring at least 95% of the frontier pick's score, or, if none does, the highest-scoring best-value model.Gemini 3.8 Flash98% of the frontier's score at 1/3 the price.
EfficientThe best-value model with the most score per dollar among those scoring at least 80% of the frontier pick's score, or among all best-value models if none does.
Quality versus cost
Each point is a model with a published NYT Connections value and complete token prices, on the 75% input / 25% output blend. Frontier models are spaced evenly along the cost axis.
NYT Connections ranking
94 models with a published NYT Connections value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.
Models ranked by their published NYT Connections LLM Benchmark (extended version) value
Rank
Model
Provider
Sort 16 to 20 words into four groups of four, one attempt per puzzle, no feedback
What the benchmark measures and how its value is published, from the source’s own record.
What is NYT Connections?
NYT Connections (NYT Connections LLM Benchmark (extended version)) is an external benchmark published by NYT Connections LLM Benchmark (Lech Mazur, GitHub). Lech Mazur's NYT Connections benchmark gives a model 940 puzzles from the New York Times word game, each with up to four extra trick words, and asks it to sort the words into four groups of four in one try. It tests word knowledge, wordplay and resisting plausible decoys. Its evaluation set is described by the source as 940 NYT Connections puzzles, each with up to four added trick words. The source rates its difficulty as wordplay, word knowledge and decoys that fit almost-but-not-quite.
How is NYT Connections scored?
Each model's result is published by NYT Connections LLM Benchmark (Lech Mazur, GitHub) as sort 16 to 20 words into four groups of four, one attempt per puzzle, no feedback. ModelChoice prints that value to 1 decimal place, exactly as published, and never converts or rescales it. This page ranks the 94 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
MonoMind is an AI transformation partner for businesses.
We are a digital agency and AI consulting studio. We help companies move from “we should be using AI” to AI that works inside their business and produces results.
What we do
AI Strategy
We start with your business, not the technology. We find where AI can reduce cost, save effort, or create new revenue, then build a clear roadmap you can act on.
Build & Deploy
We design, build, and launch the websites, platforms, and AI-powered tools in that roadmap. Everything we build is meant to go live and be used.
Marketing & Growth
A good product still needs to reach people. We turn your digital presence into a growth channel through content, search, and campaigns built for your audience.
How we work
One team, start to finish. The people who shape your strategy also deliver it. Nothing gets lost between planning and launch.
Priced by value. We charge based on the outcome we deliver, not the effort it takes. Our incentive is your result.
Local understanding. We know the languages, platforms, and business culture of the markets we serve, so our work fits how your customers actually behave.
Our belief
AI should make a business simpler and stronger, not more complicated. Our name reflects that: Mono for focus, Mind for intelligence. We focus on the few things that matter most, and we use AI to get them done well.
Let’s talk about what AI can do for your business. daren@monomind.one · https://monomind.one
ModelChoiceby MonoMind AI Lab
Evidence for practical AI runtime and cost decisions.
Every figure in this document comes from a cited upstream source and carries the date it was read. A value no source published is shown as unavailable, never as zero. The live page is updated as the sources change.
Rows are ordered by the value NYT Connections LLM Benchmark (Lech Mazur, GitHub) published, highest first. The source does not state whether a higher value is the better result, so this page does not either: for a benchmark that measures a rate of failure, read the table from the bottom.