arXiv:2608.04968cs.LG2026-08被引 1

让多个智能体协作进化任务执行程序,实现无需更新模型的持续优化。

EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement

论文配图:EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
图 1 · 摘自论文原文
  • 将任务执行程序的演化分散到本地,仅共享改进结果,避免集中数据风险。
  • 在五类任务中均提升性能,异构工作负载下效果更显著。
  • 通过证据驱动的程序融合机制,解决多源修改冲突问题,适合分布式部署场景。

大型语言模型智能体的能力不仅取决于模型本身,还依赖于其执行环境(harness):一个负责构建上下文、调用工具、验证结果并恢复失败的可执行程序。近期研究显示,演化执行环境可在不更新模型权重的情况下带来持久改进。然而,现有方法假设所有执行经验可集中至单一优化器,沿顺序轨迹演化一个环境。真实智能体生态却存在隔离的经验流——用户、组织与环境产生的经验无法汇聚,最值得学习的经验恰恰无法集中。为此提出 EvolveNet,一种协同执行环境演化的范式,将经验提取前置至数据端。共享的执行环境被分发至各本地部署的智能体,每个智能体在其自身工作负载上独立演化该环境。仅将生成的程序适应结果组合成新共享环境并重新分发,使每个参与智能体继承他人发现的运行经验。通过将聚合边界从原始工作负载转移到学习到的适应结果,EvolveNet保持工作负载本地化,允许多个演化搜索并发进行,显著降低串行深度。由于独立修改的程序无法像模型参数那样平均,且组合时可能产生冲突,EvolveNet引入作用域类型、证据引导的程序聚合机制。在文本转SQL、数据科学编程、竞赛编程、软件工程及智能体工作流五个场景中,EvolveNet在全部场景中提升了共享环境性能,尤其在异构工作负载下增益最大;消融实验表明改进主要源于不同智能体适应结果的组合,而非选择其中某一个。

原文摘要 · Abstract (English)

The capabilities of an LLM agent depend not only on its model but on the harness: the executable program that constructs context, invokes tools, verifies results, and recovers from failure. Recent work shows that evolving the harness yields persistent improvements without updating model weights. Existing approaches, however, assume that all execution experience can be routed to a single optimizer, which evolves one harness along a sequential trajectory. Real agent ecosystems violate that assumption: users, organizations, and environments generate isolated streams of experience that cannot be pooled, so the experience most worth learning from is exactly the experience that cannot be directly centralized. We introduce EvolveNet, a paradigm of collaborative harness evolution that moves experience extraction to the data. A shared harness is broadcast to data-local agent deployments, each of which evolves it on its own workload. Only the resulting program adaptations are composed into an updated shared harness and redistributed, so that every participating agent inherits operational experience discovered by the others. By shifting the aggregation boundary from raw workloads to learned adaptations, EvolveNet keeps workloads local and allows multiple evolutionary searches to proceed concurrently with reduced serial depth. Because independently modified programs cannot be averaged like model parameters and may conflict when composed, EvolveNet introduces scope-typed, evidence-guided program aggregation. Across five settings spanning text-to-SQL, data-science coding, competitive programming, software engineering, and agentic workflows, EvolveNet improves the shared harness in all five, with the largest gains under heterogeneous workloads, and ablations attribute the improvement to composition of adaptations from different agents rather than to selecting among them.

智能体系统协同演化程序优化分布式学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。