arXiv:2605.30621cs.AI2026-05被引 17

研究发现模型自我进化能力与基础性能无关,中等模型最受益。

Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents

论文配图:Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
图 1 · 摘自论文原文
  • 通过执行反馈更新外部工具链,评估模型自我进化能力
  • 弱模型更新效果差,中等模型受益最大,强模型反而不明显
  • 建议训练重点放在指令遵循和工具调用上

LLM智能体依赖可编辑的外部工具链(如提示、技能、记忆、工具)来执行任务,而无需修改模型参数。自进化通过执行证据更新这些工具链。我们分析了两种自进化能力:(i) 工具链更新能力——从执行反馈生成有效持久更新;(ii) 工具链收益能力——在任务中利用更新后工具链的能力。结果发现:第一,工具链更新能力与基础性能无关,不同能力层级模型产生的更新带来相似提升,甚至Qwen3.5-9B的更新效果与Claude Opus~4.6相当;第二,工具链收益能力非单调,弱模型收益小,中等模型收益最大,强模型反而低于中等模型。弱模型失败源于未能激活相关工具或激活后未忠实执行。建议将资源投入任务解决能力而非演化器本身,并加强工具调用与长程指令遵循训练。代码已开源。

原文摘要 · Abstract (English)

LLM agents are increasingly deployed as systems built around editable external harnesses, including prompts, skills, memories and tools, that shape task execution without changing model parameters. Harness self-evolution adapts such agents by updating these harnesses from execution evidence. Yet it remains unclear whether a model's base capability in task-solving predicts its capabilities in harness self-evolution: which models produce useful harness updates, and which actually benefit from them? We analyze two harness self-evolution capabilities: (i) harness-updating, the capability to produce useful persistent harness updates from execution evidence; (ii) harness-benefit, the capability to benefit from updated harnesses during task solving. Our analysis reveals two findings. First, harness-updating is flat in base capability: models from different capability tiers produce harness updates that lead to surprisingly similar gains; even Qwen3.5-9B's updates yield gains comparable to those of Claude Opus~4.6. Second, harness-benefit is non-monotonic in base capability: weak-tier models benefit little from updated harnesses, mid-tier models benefit most, and strong-tier models benefit less than mid-tier. We trace low gains at the weak tier to two failure modes: weak-tier models may fail to activate relevant harness artifacts, or activate them but fail to follow them faithfully. These findings suggest investing capability budget in the task-solving agent rather than the evolver, and targeting harness invocation and long-horizon instruction following in agent training. Our source code is publicly available at https://github.com/A-EVO-Lab/a-evolve/tree/release/harness-evolution.

大模型自进化工具链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。