arXiv:2604.21003cs.AI2026-04被引 3

让AI自动搭建任务执行框架,一次配置终身使用。

The Last Harness You'll Ever Build

论文配图:The Last Harness You'll Ever Build
图 1 · 摘自论文原文
  • 用自进化循环自动优化任务执行框架
  • 在多个任务上学习最优框架蓝图,新任务无需人工干预
  • 适合需要快速部署AI代理的复杂工作流场景

AI代理正被应用于复杂的领域特定流程——如企业网页操作(需数十次点击和表单填写)、多步骤研究流程(涵盖搜索、提取与综合)、跨陌生代码库的自动化代码审查,以及需细致领域知识的客户升级处理。每个新任务都需要耗时费力的人工框架工程:设计提示词、工具、编排逻辑和评估标准。本文提出两层自动化框架:第一层「框架演化循环」通过工作代理执行任务,评估代理反向诊断失败并评分,演化代理基于历史尝试修改框架;第二层「元演化循环」在多样任务中优化演化蓝图Λ = (Wₕ, H⁽⁰⁾, V, E),学习出最佳蓝图Λ⁽ᵇᵉˢᵗ⁾,使代理能在新任务上快速收敛,无需人工框架设计。该框架形式化对应元学习,提供完整算法。它将人工框架工程转变为自动化框架工程,并进一步实现自动化本身的自动生成。

原文摘要 · Abstract (English)

AI agents are increasingly deployed on complex, domain-specific workflows -- navigating enterprise web applications that require dozens of clicks and form fills, orchestrating multi-step research pipelines that span search, extraction, and synthesis, automating code review across unfamiliar repositories, and handling customer escalations that demand nuanced domain knowledge. \textbf{Each new task domain requires painstaking, expert-driven harness engineering}: designing the prompts, tools, orchestration logic, and evaluation criteria that make a foundation model effective. We present a two-level framework that automates this process. At the first level, the \textbf{Harness Evolution Loop} optimizes a worker agent's harness $\mathcal{H}$ for a single task: a Worker Agent $W_{\mathcal{H}}$ executes the task, an Evaluator Agent $V$ adversarially diagnoses failures and scores performance, and an Evolution Agent $E$ modifies the harness based on the full history of prior attempts. At the second level, the \textbf{Meta-Evolution Loop} optimizes the evolution blueprint $Λ= (W_{\mathcal{H}}, \mathcal{H}^{(0)}, V, E)$ itself across diverse tasks, \textbf{learning a blueprint $Λ^{(\text{best})}$ that enables rapid harness convergence on any new task -- so that adapting an agent to a novel domain requires no human harness engineering at all.} We formalize the correspondence to meta-learning and present both algorithms. The framework \textbf{shifts manual harness engineering into automated harness engineering}, and takes one step further -- \textbf{automating the design of the automation itself}.

AI代理自动化元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。