arXiv:2608.07545cs.NEcs.AI2026-08被引 2

让大模型代理通过自然选择进化,提升通用能力而不依赖特定任务优化。

DarwinX: Evolving Agent Harnesses Through Natural Selection

论文配图:DarwinX: Evolving Agent Harnesses Through Natural Selection
图 1 · 摘自论文原文
  • 冻结模型权重,仅演化提示、工具与流程构成的代理架构。
  • 在四个基准上平均提升17分,最高达84.7%准确率,且跨任务可迁移。
  • 支持多源证据共享编辑,避免局部最优,适合长期自主智能体开发。

大型语言模型代理的能力不仅取决于模型权重,还取决于其架构:提示、工具、技能和控制流。现有自改进循环仅沿单一谱系演化,易受路径依赖影响,局部优化常损害其他任务表现。本文提出DarwinX,将自演化视为对代理架构种群的自然选择,模型保持冻结:采用‘保留并扩展’契约,仅允许扩展覆盖范围而不退化的变体;建立档案保存多条独立谱系以供重组;失败、教师及自我生成的证据共用同一编辑接口。适应度由各基准自身的验证器决定,无需人工标注答案或胜者。在四个逐步增强演进信号与测试分离度的基准上,单轮迭代平均提升约17分:Terminal-Bench 2.1在同基线提升7.7至83.2%,在更强基线上达到84.7%已验证前沿;TerminalWorld持留分割达到68.3%,超越所有现成代理;WebArena-Infinity真实任务pass@1从43.5%升至93.0%(审计纯净);且Terminal-Bench 2.1的架构无需修改即迁移到SWE-bench Verified。演化的本质是通用代理能力,而非特定基准的修补,因此能抵抗任务、验证器与基模型变化。冻结模型并非固定代理:架构选择将评估算力转化为持久能力。

原文摘要 · Abstract (English)

An LLM agent's capability depends not only on model weights but on its harness: prompts, tools, skills, and control flow. Self-improvement loops already edit harnesses, yet single-lineage search is path-dependent and local wins often regress other tasks. We introduce DarwinX, which treats self-evolution as selection over a population of harnesses with the model frozen: a preserve-and-extend contract admits only variants that extend coverage without regressing, an archive keeps alternative lineages for recombination, and failure-, teacher-, and self-derived evidence share one edit interface. Fitness comes from each benchmark's own verifier: no gold solutions, no hand-picked winners. Across four benchmarks that progressively separate the evolution signal from the test, one loop adds about 17 points on average: Terminal-Bench 2.1 rises +7.7 to 83.2% on a matched base and to the verified frontier at 84.7% on a stronger one; TerminalWorld's held-out split reaches 68.3%, ahead of every off-the-shelf agent; WebArena-Infinity real-task pass@1 rises from 43.5% to 93.0% audit-clean; and a Terminal-Bench 2.1 harness transfers unchanged to SWE-bench Verified. What evolves is general agent competence, not benchmark-specific patches, so it survives changes of task, verifier, and base model. A frozen model need not be a fixed agent: harness selection turns evaluation compute into durable capability.

智能体自进化大模型自然选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。