arXiv:2607.26598cs.MAcs.AI2026-07被引 1

让智能体的执行框架能自我进化,持续修复错误。

Living-Harness Is an Interactive-Agent Evolver

论文配图:Living-Harness Is an Interactive-Agent Evolver
图 1 · 摘自论文原文
  • 用任务完成轨迹和评估信号驱动框架更新,实现自演化。
  • 在两个基准上分别提升成功率10.07%和9.91%。
  • 适合需要长期迭代优化的交互式智能体系统。

大型语言模型代理在单次任务中可自我恢复,但失败模式常在后续任务中重复出现,因任务后反馈极少更新持续引导交互的固定框架。静态框架通过固定工具、上下文、记忆和工作流结构提升可靠性,但部署后不再改变。本文提出《Living-Harness》,一种自演化代理框架,将每个完成的轨迹及其评估信号转化为有限范围内的框架更新证据。在领域级《Evolution-SOP》指导下,Living-Harness提取任务抽象与结构化更新证据,并生成两类互补的过程知识:记录触发条件、失败模式与恢复动作的事件记忆,以及记录状态节点、修复边与转移规则的状态图。更新后的框架状态用于指导未来交互,而工具与基础上下文保持冻结,允许过程性修复在演化周期间累积。在基于τ²-Bench和MultiWOZ-2.4构建的八个交互环境上,Living-Harness相较最强基线分别提升Pass@1平均得分10.07和9.91个百分点,并支持仅通过检索复用演化后的框架状态,适用于不同模型主干。代码将很快公开于https://github.com/anotherbricki/Living-Harness。

原文摘要 · Abstract (English)

Large language model (LLM) agents may recover from a failure within an episode or after a retry, yet the same execution failure can recur in later tasks because post-episode feedback rarely revises the persistent harness that guides future interactions. Static harnesses improve reliability through fixed tools, context, memory, and workflow structures, but remain unchanged after deployment. We propose $\textbf{Living-Harness}$, a self-evolving agent harness that converts each completed trajectory and its evaluator signals into posterior evidence for bounded harness updates. Guided by a domain-level $\textbf{Evolution-SOP}$ ($\textbf{S}$tandard $\textbf{O}$perating $\textbf{P}$rocedure), Living-Harness extracts an episode abstraction and structured update evidence, and writes two complementary forms of procedural knowledge: episodic memory that records trigger conditions, failure patterns, and recovery actions, and a state graph that records state nodes, repair edges, and transition rules. The updated harness state is retrieved to guide future interactions, while tools and base context remain frozen, allowing procedural repairs to accumulate across evolution cycles. On eight interactive environments derived from $τ^2$-Bench and MultiWOZ-2.4, Living-Harness improves average Pass@1 over the strongest interactive baseline by 10.07 and 9.91 percentage points, respectively, and supports retrieval-only reuse of the evolved harness state across model backbones. Our code will be made publicly available soon at https://github.com/anotherbricki/Living-Harness.

智能体自演化框架更新交互系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。