arXiv:2607.13683cs.CL2026-07被引 4

通过基因库筛选与门控验证,实现智能体自进化的能力提升

HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolution

论文配图:HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolution
图 1 · 摘自论文原文
  • 构建可迭代优化的智能体能力基因库,分阶段生成并筛选高质量配置
  • 在7个基准上实现5.1%至15.4%的性能提升,避免搜索崩溃和过拟合
  • 适合追求自动化智能体优化的开发者与研究者,尤其关注可验证演进

大型语言模型(LLMs)已使各类智能体具备强大能力。智能体的表现不仅取决于基础模型,更受其周围环境(如提示词、工具、控制循环等)即“智能体装置”(agent harness)的影响。自动演化该装置是提升智能体性能的可行路径,但现有方法多依赖贪婪候选选择和噪声自反馈,易导致搜索崩溃、任务过拟合及验证困难。为此,我们提出HarnessBank,一种可信的智能体装置自演化框架,将任务智能体与独立演化智能体配对,实现故障诊断、装置生成与验证的迭代过程。该框架维护一个包含不同语义维度高性能装置的装置基因库,通过重设计、重组、筛选与选择完成自演化。此外,提出门控装置筛选机制,高效过滤优质装置,降低大量后代装置的评估成本。在七个智能体基准测试中,HarnessBank实现5.1%至15.4%的持续性能提升。跨模型实验进一步验证,提升来自模型特定的自演化过程,而非通用最优装置。代码将在接受后公开。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have enabled capable agents across diverse applications. Beyond the foundation model, the performance of an agent is governed by the surrounding agent harness, including prompts, tools, control loops, etc. Automatically evolving this harness offers a promising pathway to agent improvement, yet existing approaches typically rely on greedy candidate selection and noisy self-generated feedback, rendering their gains susceptible to search collapse, task-specific overfitting, and poor verifiability. To tackle these challenges, we introduce HarnessBank, a trustworthy agent-harness self-evolution framework that pairs a task agent with a separate evolver agent for iterative failure diagnosis, harness generation, and evolution verification. HarnessBank maintains a Harness Gene Bank composed of high-performing harnesses of different semantic coordinates. Those harnesses are reinvented, recombined, screened, and selected during the self-evolution procedure. Moreover, we propose a Gated Harness Screening mechanism to efficiently filter high-quality harnesses and reduce the cost of evaluating numerous offspring harnesses. Across seven agent benchmarks, HarnessBank produces consistent performance improvements from 5.1% to 15.4%. Cross-model experiments further verify that the improvements come from the model-specific self-evolving process, instead of a universally optimal harness. Our code will be publicly available upon acceptance.

智能体演化自进化基因库门控筛选

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。