让大模型智能体同时优化执行结构与推理策略,提升适应能力。
HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems

- 将智能体系统拆解为执行结构与推理策略,分层演进。
- 在五个不同领域任务中,性能最高提升12.0%,优于单一优化方案。
- 适合需要动态适配复杂任务的智能体系统开发者使用。
大语言模型智能体需在异构任务环境中运行,这对固定结构的智能体系统构成挑战,亟需系统级元自适应能力。现有工作仅分别优化外部执行框架或内部推理策略,缺乏对两者协同演化的建模。本文提出HarnessForge,将智能体系统定义为‘执行框架-推理策略’对,建立稳定适配空间,分离执行结构与推理行为。通过故障引导的框架定制和框架条件下的策略对齐,实现双轨协同进化。在五个来自不同领域的基准测试中,HarnessForge持续提升Qwen3-4B与Qwen3-8B模型表现,相较仅优化框架或仅优化策略的基线,性能最高提升12.0%,并取得良好的部署效率平衡,验证了框架与策略协同演进的有效性及可执行兼容性的关键作用。代码已开源。
原文摘要 · Abstract (English)
LLM agents are increasingly expected to operate across heterogeneous task regimes that require distinct execution paradigms. This challenges fixed agent systems and motivates system-level meta-adaptation beyond isolated component updates. While existing works have adapted external harness or trained underlying reasoning policies, full-system adaptation remains insufficiently characterized. The adaptation space between structure and execution is rarely made explicit, and the compatibility between the external harness and the internal reasoner is not optimized jointly. We propose HarnessForge, a meta-adaptive framework for evolving LLM agent systems. HarnessForge formulates an agent system as a harness--policy pair, defining a stable adaptation space that separates harness-level execution structure from policy-level reasoning behavior. It then performs harness--policy co-evolution through fault-guided harness tailoring and harness-conditioned policy alignment. Experiments across five benchmarks from diverse domains show that HarnessForge consistently improves both Qwen3-4B and Qwen3-8B backbones, outperforming harness-only and policy-only baselines with gains of up to 12.0\% over the strongest baseline and achieving favorable rollout-efficiency tradeoffs, demonstrating that harness--policy co-evolution is effective, and that executable compatibility between the harness and reasoning policy is essential for agent-system adaptation. The code is available at https://github.com/mingju-c/HarnessForge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。