{"id":776,"date":"2026-04-23T11:46:24","date_gmt":"2026-04-23T03:46:24","guid":{"rendered":"https:\/\/connectword.dpdns.org\/?p=776"},"modified":"2026-04-23T11:46:24","modified_gmt":"2026-04-23T03:46:24","slug":"xiaomi-releases-mimo-v2-5-pro-and-mimo-v2-5-matching-frontier-model-benchmarks-at-significantly-lower-token-cost","status":"publish","type":"post","link":"https:\/\/connectword.dpdns.org\/?p=776","title":{"rendered":"Xiaomi Releases MiMo-V2.5-Pro and MiMo-V2.5: Matching Frontier Model Benchmarks at Significantly Lower Token Cost"},"content":{"rendered":"

Xiaomi MiMo team publicly released two new models: MiMo-V2.5-Pro<\/strong> and MiMo-V2.5<\/strong>. The benchmarks, combined with some genuinely striking real-world task demos, make a compelling case that open agentic AI is catching up to the frontier faster than most expected. Both models are available immediately via API, and priced competitively. <\/p>\n

What is an Agentic Model, and Why Does It Matter?<\/strong><\/h3>\n

Most LLM benchmarks test a model\u2019s ability to answer a single, self-contained question. Agentic benchmarks test something much harder \u2014 whether a model can complete a multi-step goal<\/em> autonomously, using tools (web search, code execution, file I\/O, API calls) over many turns, without losing track of the original objective.<\/p>\n

Think of it as the difference between a model that can answer \u201chow do I write a lexer?\u201d versus one that can actually write a complete compiler<\/em>, run tests against it, catch regressions, and fix them \u2014 all without a human in the loop. The latter is exactly what Xiaomi MiMo team is demonstrating here.<\/p>\n

MiMo-V2.5-Pro: The Flagship<\/strong><\/h3>\n

MiMo-V2.5-Pro is Xiaomi\u2019s most capable model to date, delivering significant improvements over its predecessor, MiMo-V2-Pro, in general agentic capabilities, complex software engineering, and long-horizon tasks.<\/p>\n

The key benchmark numbers are competitive with top closed-source models: SWE-bench Pro 57.2, Claw-Eval 63.8, and \u03c43-Bench 72.9 \u2014 placing it alongside Claude Opus 4.6 and GPT-5.4 across most evaluations. V2.5-Pro can sustain complex, long-horizon tasks spanning more than a thousand tool calls, demonstrating substantial improvements in instruction following within agentic scenarios, reliably adhering to subtle requirements embedded in context and maintaining strong coherence across ultra-long contexts.<\/p>\n

One behavioral property that distinguishes V2.5-Pro from earlier models is what Xiaomi MiMo team calls \u201charness awareness\u201d<\/strong>: it makes full use of the affordances of its harness environment, manages its memory, and shapes how its own context is populated toward the final objective. This means the model doesn\u2019t just execute instructions mechanically. It actively optimizes its own working environment to stay on track across very long tasks. <\/p>\n

The three real-world task demos Xiaomi published illustrate exactly what \u201clong-horizon agentic capability\u201d means in practice.<\/strong><\/p>\n

Demo 1 \u2014 SysY Compiler in Rust<\/strong>: Referred from Peking University\u2019s Compiler Principles<\/a> course project, this task asks the model to implement a complete SysY compiler in Rust from scratch: lexer, parser, AST, Koopa IR codegen, RISC-V assembly backend, and performance optimization. The reference project typically takes a PKU CS major student several weeks. MiMo-V2.5-Pro finished in 4.3 hours across 672 tool calls, scoring a perfect 233\/233 against the course\u2019s hidden test suite.<\/p>\n

What\u2019s notable isn\u2019t just the final score \u2014 it\u2019s the architecture of execution. Rather than thrashing through trial and error, the model built the compiler layer by layer: scaffold the full pipeline first, perfect Koopa IR (110\/110), then the RISC-V backend (103\/103), then performance (20\/20). The first compile alone passed 137\/233 tests, a 59% cold start that suggests the architecture was designed correctly before a single test was run. When a refactoring step later caused regressions, the model diagnosed the failures, recovered, and pushed on. This is structured, self-correcting engineering behavior \u2014 not pattern-matched code generation.<\/p>\n

Demo 2 \u2014 Full-Featured Desktop Video Editor<\/strong>: With just a few simple prompts, MiMo-V2.5-Pro delivered a working desktop app: multi-track timeline, clip trimming, cross-fades, audio mixing, and export pipeline. The final build is 8,192 lines of code, produced over 1,868 tool calls across 11.5 hours of autonomous work.<\/p>\n

Demo 3 \u2014 Analog EDA- FVF-LDO Design<\/strong>: This is the most technically specialized demo: a graduate-level analog-circuit EDA task requiring the design and optimization of a complete FVF-LDO (Flipped-Voltage-Follower low-dropout regulator) from scratch in the TSMC 180nm CMOS process. The model had to size the power transistor, tune the compensation network, and pick bias voltages so that six metrics land within spec simultaneously \u2014 phase margin, line regulation, load regulation, quiescent current, PSRR, and transient response. Wired into an ngspice simulation loop, in about an hour of closed-loop iteration \u2014 calling the simulator, reading waveforms, tweaking parameters \u2014 the model produced a design where every target metric is met, with four key metrics improved by an order of magnitude over its own initial attempt.<\/p>\n

Token Efficiency<\/strong>: Intelligence at frontier level is only useful if it\u2019s cost-effective. On ClawEval, V2.5-Pro lands at 64% Pass^3 using only ~70K tokens per trajectory \u2014 roughly 40\u201360% fewer tokens than Claude Opus 4.6, Gemini 3.1 Pro, and GPT-5.4 at comparable capability levels. For engineers building production agent pipelines, this is a material cost reduction, not just a marketing stat.<\/p>\n

\n
\"\"
https:\/\/mimo.xiaomi.com\/mimo-v2-5-pro\/<\/figcaption><\/figure>\n<\/div>\n

MiMo Coding Bench<\/strong> is Xiaomi\u2019s in-house evaluation suite designed to assess models on real-world developer tasks within agentic frameworks like Claude Code. It covers repo understanding, project building, code review, structured artifact generation, planning, SWE, and more. V2.5-Pro leads the field on this benchmark, and Xiaomi explicitly positions it as a drop-in backend for scaffolds including Claude Code, OpenCode, and Kilo.<\/p>\n

MiMo-V2.5: Native Omnimodal at Half the Cost<\/strong><\/h3>\n

While V2.5-Pro targets the hardest long-horizon agentic tasks, MiMo-V2.5 is a major step forward in agentic capability and multimodal understanding. With native visual and audio understanding, MiMo-V2.5 reasons seamlessly across modalities, surpasses MiMo-V2-Pro in agentic performance, and supports up to 1 million tokens of context.<\/p>\n

The model is designed with perception and action unified from scratch. MiMo-V2.5 is trained from the start to see, hear, and act on what it perceives, leading to a single model that understands everything and gets things done. This is architecturally significant \u2014 earlier multimodal models often bolted vision on top of a text backbone, creating capability gaps at the perception-action boundary.<\/p>\n

On the coding side, the value proposition is clear: in MiMo Coding Bench, MiMo-V2.5 delivers strong results on everyday coding tasks, closing the gap with frontier models and matching MiMo-V2.5-Pro at half the cost. For teams that don\u2019t need the extreme long-horizon depth of V2.5-Pro, this is a compelling operating point.<\/p>\n

\n
\"\"
https:\/\/mimo.xiaomi.com\/mimo-v2-5\/<\/figcaption><\/figure>\n<\/div>\n

On multimodal benchmarks: MiMo-V2.5 achieves a 62.3 on the Claw-Eval general subset, placing it at the Pareto frontier of performance and efficiency. On the multimodal agentic subset, MiMo-V2.5 reaches 23.8 on Claw-Eval Multimodal, matching Claude Sonnet 4.6, leading MiMo-V2-Omni by eight points, and trailing Claude Opus 4.6 by a single point.<\/p>\n

On video understanding, MiMo-V2.5 scores 87.7 on Video-MME, effectively tied with Gemini 3 Pro (88.4) and well ahead of Gemini 3 Flash. Long-horizon video comprehension \u2014 scene tracking, temporal reasoning, visual grounding over minutes of footage \u2014 is now in frontier territory. On image understanding, MiMo-V2.5 lands at 81.0 on CharXiv RQ and 77.9 on MMMU-Pro, closing in on Gemini 3 Pro.<\/p>\n

Pricing is straightforward: MiMo-V2.5 runs at 1x (1 token = 1 credit), while MiMo-V2.5-Pro runs at 2x (1 token = 2 credits). Token Plans no longer charge a multiplier for the 1M-token context window \u2014 previously a common cost friction for long-context agentic workloads.<\/p>\n

Key Takeaways<\/strong><\/h3>\n