ModelChoiceby MonoMind AI LabCoding benchmark
IDE-Bench leaderboard
Every model the catalog carries a published IDE-Bench value for, ranked by that value.
- Printed
- Page
- https://modelchoice.dev
About this benchmark
An 80-task software-engineering benchmark across eight repositories that tests whether autonomous IDE agents can explore, edit, run, and verify code changes end to end. 0 models in the ModelChoice catalog have a published value.
When it's a good referenceUse it when choosing a model for programming work. Check whether the task is small puzzles or real repositories, and match that to the work you have.
CategoryCoding
MeasureAutonomous IDE-agent task completion (pass@1)
Tasks80 tasks across 8 repositories
DifficultyEnd-to-end software engineering
No model in the catalog has a published IDE-Bench score.The benchmark is defined by IDE-Bench, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.
About IDE-Bench
What the benchmark measures and how its value is published, from the source’s own record.
What is IDE-Bench?
IDE-Bench is a coding benchmark published by IDE-Bench. An 80-task software-engineering benchmark across eight repositories that tests whether autonomous IDE agents can explore, edit, run, and verify code changes end to end. Its evaluation set is described by the source as 80 tasks across 8 repositories. The source rates its difficulty as end-to-end software engineering.
How is IDE-Bench scored?
Each model's result is published by IDE-Bench as autonomous IDE-agent task completion (pass@1). ModelChoice prints that value to 2 decimal places, exactly as published, and never converts or rescales it. This page ranks the 0 models that carry a published value, highest value first; a model the source never scored is left out rather than ranked at zero. The source does not state whether a higher value is the better result, so neither does this page.
About MonoMindmonomind.oneMonoMind is an AI transformation partner for businesses.
We are a digital agency and AI consulting studio. We help companies move from “we should be using AI” to AI that works inside their business and produces results.
What we do
- AI Strategy
- We start with your business, not the technology. We find where AI can reduce cost, save effort, or create new revenue, then build a clear roadmap you can act on.
- Build & Deploy
- We design, build, and launch the websites, platforms, and AI-powered tools in that roadmap. Everything we build is meant to go live and be used.
- Marketing & Growth
- A good product still needs to reach people. We turn your digital presence into a growth channel through content, search, and campaigns built for your audience.
How we work
- One team, start to finish. The people who shape your strategy also deliver it. Nothing gets lost between planning and launch.
- Priced by value. We charge based on the outcome we deliver, not the effort it takes. Our incentive is your result.
- Local understanding. We know the languages, platforms, and business culture of the markets we serve, so our work fits how your customers actually behave.
Our belief
AI should make a business simpler and stronger, not more complicated. Our name reflects that: Mono for focus, Mind for intelligence. We focus on the few things that matter most, and we use AI to get them done well.
Let’s talk about what AI can do for your business.
daren@monomind.one · https://monomind.one
ModelChoiceby MonoMind AI LabEvidence for practical AI runtime and cost decisions.
Every figure in this document comes from a cited upstream source and carries the date it was read. A value no source published is shown as unavailable, never as zero. The live page is updated as the sources change.
- Live page
- https://modelchoice.dev
- Sources
- https://modelchoice.dev/sources
- Printed
© 2026 MonoMind AI Lab · modelchoice.dev