arXiv:2607.08124cs.SEcs.LG2026-07被引 3

让AI助手在测试时自动优化执行流程,无需标注数据。

TTHE: Test-Time Harness Evolution

论文配图:TTHE: Test-Time Harness Evolution
图 1 · 摘自论文原文
  • 用可执行程序作为适应状态,通过代理和评判者迭代改进
  • 在多个任务上优于固定流程基线,且改进可长期保持
  • 无需更新模型权重,适合部署后持续优化复杂任务

大语言模型智能体的行为不仅由模型本身决定,还取决于其执行流程:即构建上下文、调用工具、验证中间结果并恢复失败的可执行程序。现有方法在部署前优化流程,基于训练或开发数据搜索固定工作流并冻结于测试阶段,导致在测试分布、故障模式或工具交互变化时难以适应。本文提出测试时执行流程演化(TTHE),允许在评估过程中仅使用智能体对测试输入生成的无标签执行轨迹,动态优化执行流程。TTHE将可执行流程视为测试时自适应的状态,维护候选流程种群,通过代理根据执行轨迹进行推理,由评判者依据执行衍生的代理信号选择更优流程,新流程将用于后续输入。关键在于不更新模型权重、无需真实标签或任务特定监督:求解器、代理与评判者均为同一冻结大模型的不同角色,所有适应均通过程序结构调整实现。在文本转SQL、编程竞赛、软件工程、数据科学编码及智能体工具使用等任务中,TTHE持续优于固定ReAct风格基线,实现可观察、持久的性能提升,而非预先搜索的工作流或单次查询重试。该研究将大模型智能体的测试时自适应重新定义为可执行控制程序的演化过程,并揭示执行衍生代理信号可靠性是鲁棒无监督改进的核心挑战。

原文摘要 · Abstract (English)

The behavior of an LLM agent is determined not only by the underlying model, but also by its harness: the executable program that constructs context, invokes tools, verifies intermediate results, and recovers from failures. Existing approaches optimize such harnesses before deployment, searching training or development data for a fixed agent workflow that is then frozen at test time. This limits adaptation when the test distribution, failure modes, or tool interactions differ from those seen during development. We ask whether the harness can instead be optimized during evaluation itself, using only the unlabeled execution traces the agent produces on the test inputs. We introduce Test-Time Harness Evolution (TTHE), which treats the executable harness as the state of test-time adaptation. During evaluation, TTHE maintains a population of candidate harnesses and refines them through an agentic proposer that reasons over their execution traces, without gold labels or task-specific supervision; a judge then commits an improved harness from execution-derived proxy signals, and the selected program persists to govern subsequent inputs. Crucially, TTHE does not update model weights, require gold labels, or train a separate adaptation model: solver, proposers, and judge are different roles and harnesses around the same frozen LLM, so all adaptation occurs through changes to the surrounding program. Across text-to-SQL, competitive programming, software engineering, data-science coding, and agentic tool-use tasks, TTHE improves fixed ReAct-style baseline harnesses, yielding persistent, inspectable improvements rather than a pre-searched workflow or per-query retries. These results recast test-time adaptation for LLM agents as evolution over executable control programs and identify execution-derived proxy reliability as a central challenge for robust unsupervised agent improvement.

测试时适应智能体优化无监督学习执行演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。