arXiv:2608.26530cs.AI2026-08

让智能体在执行中实时自我改进,边做边学边调整。

PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents

论文配图:PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents
图 1 · 摘自论文原文
  • 分离监督者与执行者,动态调整当前任务路径。
  • 实测性能提升最高达9.8个百分点,效率显著优化。
  • 适合长时序任务的自主优化,尤其适合高复杂度场景。

长时序智能体运行过程中产生的经验可用于改进当前任务和未来工作。现有自改进方法通常仅在任务结束后处理经验,无法实时调整正在进行的任务或立即验证学习成果。本文提出PILOT,一种支持实时自改进的监督-执行架构,包含两个耦合机制:(1) 实时引导(live steering)允许独立的监督者在执行中动态调整或终止当前执行者;(2) 实时自演化(live self-evolution)将执行中暴露的流程与失败模式提炼为可复用技能与记忆。在两个固定骨干模型和三个基准测试中,PILOT在六组配置中有五组排名第一。在Terminal-Bench 2.0上,性能优于对比方法最高达9.8个百分点。在自改进设置下,相较于基线,使用GLM-5.1提升14.6点,Kimi-K2.6提升12.4点。平均输出词数下降42.9%与47.4%,每百万输出词的成功评估次数分别提升110.3%与134.0%。

原文摘要 · Abstract (English)

Long-horizon agent runs generate experience that can improve both the current run and future work. Most self-improvement methods process this experience only after execution ends, so they cannot redirect the active run or immediately apply and validate lessons learned from it. We argue that self-improvement should instead be live, using emerging experience both to redirect the active run and to update the persistent harness. Existing agent architectures do not fully support this goal. Single-agent self-correction combines task execution and trajectory assessment within one context, while subagent delegation separates execution but typically cannot redirect an active subagent. We present PILOT, a supervisor-worker harness for live self-improvement through two coupled mechanisms: (1) live steering lets a separate supervisor redirect or abort the active worker during execution; and (2) live self-evolution distils procedures and failure modes revealed during execution into reusable skills and memory. Across two frozen backbones and three benchmarks, PILOT ranks first in five of six configurations. On Terminal-Bench 2.0, PILOT outperforms counterpart harnesses by up to 9.8 percentage points. In the self-improvement setting, PILOT gains 14.6 points with GLM-5.1 and 12.4 points with Kimi-K2.6. Mean output tokens fall by 42.9% and 47.4%, while successful evaluations per million output tokens rise by 110.3% and 134.0%, respectively.

智能体自改进实时优化长时序任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。