{"id":910,"date":"2026-05-15T11:38:10","date_gmt":"2026-05-15T03:38:10","guid":{"rendered":"https:\/\/connectword.dpdns.org\/?p=910"},"modified":"2026-05-15T11:38:10","modified_gmt":"2026-05-15T03:38:10","slug":"poetiqs-meta-system-automatically-builds-a-model-agnostic-harness-that-improved-every-llm-tested-on-livecodebench-pro-without-fine-tuning","status":"publish","type":"post","link":"https:\/\/connectword.dpdns.org\/?p=910","title":{"rendered":"Poetiq\u2019s Meta-System Automatically Builds a Model-Agnostic Harness That Improved Every LLM Tested on LiveCodeBench Pro Without Fine-Tuning"},"content":{"rendered":"

Poetiq has just published some very interesting results showing its Meta-System reached a new state-of-the-art on LiveCodeBench Pro (LCB Pro), a competitive coding benchmark, by automatically building and optimizing its own inference harness \u2014 without fine-tuning any underlying model or accessing model internals.<\/p>\n

The result: GPT 5.5 High with Poetiq\u2019s harness scores 93.9% on LCB Pro (25Q2), up from its baseline of 89.6%. Gemini 3.1 Pro, the model the harness was specifically optimized on, jumps from 78.6% to 90.9% \u2014 surpassing Google\u2019s own Gemini 3 Deep Think (88.8%), a model that isn\u2019t even accessible via API for external verification.<\/p>\n

\n
\"\"
https:\/\/poetiq.ai\/posts\/recursive_self_improvement_coding\/<\/figcaption><\/figure>\n<\/div>\n

What is LiveCodeBench Pro?<\/strong><\/h2>\n

Before getting into the mechanics, it helps to understand why the benchmark matters. LiveCodeBench Pro (LCB) is designed to test AI coding ability in a way that resists two common failure modes in benchmarks: data contamination and overfitting.<\/p>\n

LCB Pro pulls problems from major competitive programming competitions and withholds public ground-truth code. Instead, solutions are validated against a comprehensive testing framework. Correct output alone isn\u2019t enough \u2014 solutions must also satisfy specific memory and runtime constraints. The benchmark is also subject to continuous updates, which distinguishes it from many standard benchmarks that become stale.<\/p>\n

The benchmark focuses on C++ challenges and emphasizes creative coding, testing a model\u2019s capacity for complex problem-solving and high-quality, performant procedural logic. This distinguishes it from datasets like SWEBench that evaluate tool usage or bug-fixing workflows. Problems are categorized by difficulty \u2014 Easy, Medium, and Hard \u2014 based on competitive human solve rates.<\/p>\n

\n
\"\"
https:\/\/poetiq.ai\/posts\/recursive_self_improvement_coding\/<\/figcaption><\/figure>\n<\/div>\n

Poetiq\u2019s Strategic Framing: Three LLM Task Categories<\/strong><\/h2>\n

This is Poetiq\u2019s third publicly reported benchmark, and the choice of LCB Pro was deliberate. The research team frames LLM performance around three distinct task categories: Reasoning challenges (ARC-AGI is their benchmark here), Retrieval challenges (Humanity\u2019s Last Exam, or HLE), and Coding challenges \u2014 which, as the most pervasive commercial application for AI today, meld reasoning and retrieval with the generation of specialized procedural logic.<\/p>\n

Their coding initiative had three specific, stated objectives: first, prove that an intelligent harness can boost efficacy without fine-tuning or special model access; second, validate the Meta-System\u2019s capacity for recursive self-improvement in creating that harness automatically; and third, demonstrate that the resulting harness is model-agnostic and can be applied to any model without modification. According to their results, all three were satisfied.<\/p>\n

What is a Harness, and Why Does It Matter?<\/strong><\/h2>\n

In this context, a harness refers to the infrastructure wrapped around a language model to handle a specific task. Think of it as an orchestration layer \u2014 it controls how the model is prompted, how outputs are structured, how answers are assembled across multiple calls, and how solutions are evaluated.<\/p>\n

Traditionally, these harnesses are hand-built by engineers. Poetiq\u2019s claim is that their Meta-System builds and optimizes these harnesses automatically, through recursive self-improvement. Internally, the Meta-System works by developing better strategies for determining what to ask, refining sequential chain-of-questions, and devising new methods for assembling the answers. The system constantly incorporates learnings from previous and current tasks and datasets to create new, custom task-specific harnesses \u2014 as well as agents and orchestrators for other task types.<\/p>\n

How the Harness was Built<\/strong>?<\/h2>\n

Poetiq\u2019s Meta-System was given the LCB Pro task and constructed a harness from scratch using only Gemini 3.1 Pro as the base model. The Meta-System accounted for all three dimensions LCB Pro tests: accuracy, runtime, and memory constraints. The system built on insights from its previous work on ARC-AGI and HLE when designing the harness. No fine-tuning of the underlying model was performed, and no access to internal model activations was required \u2014 only standard API access.<\/p>\n

Once the harness was built and optimized for Gemini 3.1 Pro, it was then applied to a broad set of other models from different providers and generations \u2014 both open-weights and proprietary \u2014 without any additional optimization. Every model tested improved.<\/p>\n

The Numbers<\/strong><\/h2>\n

The benchmark results across difficulty tiers are worth looking at in detail. On Hard problems \u2014 the category where gaps between models are largest \u2014 Gemini 3.1 Pro with Poetiq\u2019s harness scores 58.3%, up from its 7.7% baseline. GPT 5.5 High with the harness reaches 75.0% on Hard, up from 50.0%. Across Easy and Medium categories, the harness also outperforms all base models.<\/p>\n

Some of the smaller model results are also notable. Gemini 3.0 Flash improves by 10 percentage points, going from 72.3% to 82.3% \u2014 overtaking Claude Opus 4.7, Gemini 3.1 Pro, and GPT 5.2 High, all larger and more expensive models. This mirrors a pattern Poetiq previously observed on ARC-AGI, where their optimization allowed a smaller, more economical model to surpass a bigger one. Kimi K2.6 sees the largest jump: from 50.0% to 79.9%, a roughly 30 percentage point improvement. Nemotron 3 Super 120B improves by 12.8%.<\/p>\n

Accuracy numbers are reported directly from the LCB Pro leaderboard at livecodebenchpro.com (25Q2). For models not featured on the leaderboard, Poetiq conducted its own evaluations, cross-validating its experimental setup by replicating official leaderboard accuracies for baseline models.<\/p>\n

Key Takeaways<\/strong><\/h2>\n