arXiv:2606.01770cs.LGcs.AI2026-06被引 10

让AI代理持续进化,应对不断变化的任务流。

Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams

论文配图:Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
图 1 · 摘自论文原文
  • 通过状态化多智能体演化框架,动态调整任务适配策略。
  • 在多个开放任务流上表现优于现有基线,长期性能更稳定。
  • 适合需要长期部署、动态适应的复杂智能体系统开发者。

Auto-harness 系统如 A-Evolve、GEPA 和 Meta-Harness 能通过执行反馈优化大模型代理的提示词、技能、工具、记忆和基础设施,但通常只在固定离线基准上评估。实际部署面临开放性任务流:历史无固定终点,任务异构,问题分布随时间演变。单一频繁更新的 harness 易变脆,准确率早期达峰后下降。为此,我们提出 Adaptive Auto-Harness 框架与系统,用于此类任务流。该框架将与理想 harness 的差距分解为演化损失与适应损失。系统通过状态化多智能体演化器、求解时路由的 harness 树及人工干预钩子,分别应对两类损失。在预测市场、安全竞赛和事件预测任务流上,该系统显著优于五种现有 auto-harness 基线,消融实验表明提升来自更优的构建、路由或针对性人工引导。代码已开源。

原文摘要 · Abstract (English)

Auto-harness systems such as A-Evolve, GEPA, and Meta-Harness improve LLM agents by optimizing prompts, skills, tools, memories, and supporting infrastructure from execution feedback, but they are typically evaluated on fixed offline benchmarks. Real deployments instead present open-ended task streams: histories grow without a fixed endpoint, heterogeneous tasks require different harnesses, and problem distributions shift over time. These challenges make a single repeatedly and densely updated harness brittle, causing performance degradation as accuracy peaks early and then declines. This motivates sustained harness construction with task-wise adaptation. We introduce Adaptive Auto-Harness, a framework and system for such streams. The framework decomposes the gap to an oracle harness into evolution loss and adaptation loss. The system addresses these losses with a stateful multi-agent evolver, a harness tree with solve-time routing, and human-steering hooks for cases where history lacks the needed signal. Across prediction-market, security-competition, and event-forecasting streams, Adaptive Auto-Harness outperforms five existing auto-harness baselines and ablations attribute gains to better construction, routing, or targeted human steering. Code is available in \href{https://github.com/A-EVO-Lab/a-evolve/tree/release/adaptive-auto-harness}{Link}.

智能体系统持续学习任务流自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。