arXiv:2609.02074cs.AI2026-09

提出可区分计划与执行贡献的自进化记忆框架,让智能体推理时持续改进规划能力。

CHIME: Credit-Aware Hierarchical Memory Evolution for Long-Horizon Agentic Planning

论文配图:CHIME: Credit-Aware Hierarchical Memory Evolution for Long-Horizon Agentic Planning
图 1 · 摘自论文原文
  • 分设计划与执行记忆库,按任务结果归因更新对应记忆
  • 在4个长时程基准上表现优于现有方法,用更少记忆项达成更高效果
  • 适合需要长期规划且资源受限的自主智能体系统

规划是智能体将复杂长周期任务分解为可操作步骤的核心能力。现有测试时搜索和训练式方法存在推理开销高或需大量训练数据的问题。自进化记忆通过积累交互经验提升推理时的规划能力,无需参数更新。但现有方法存在固有的信用分配难题:依赖最终任务结果反馈,而该结果同时受计划质量、执行错误和环境因素影响,导致积累的经验存在偏差和噪声。为此,我们提出信用感知的层次化记忆演化框架CHIME,其维护独立的计划记忆库与执行记忆库,并遵循‘属性先行,再存入’原则:先判定任务结果应归因于计划、执行、两者或均无关,再仅更新对应的记忆库。在四个长周期智能体基准上的实验表明,CHIME consistently优于最先进的训练型与自进化记忆基线。进一步分析揭示:CHIME以远少的记忆条目积累有效经验;学习到的记忆值能准确反映下游效用——高质量计划记忆比执行记忆更具价值;且累积记忆可在不同主干模型间有效迁移。代码将于https://github.com/ATH-MaaS/Marco-DeepResearch发布。

原文摘要 · Abstract (English)

Planning is a central capability that enables agents to decompose complex long-horizon tasks into manageable steps. Test-time search and training-based methods improve planning but incur high inference costs or require expensive training data. Self-evolving memory instead accumulates reusable experience from agent interaction outcomes into an external memory bank, so planning capability keeps improving at inference time without parameter updates. However, existing self-evolving memory methods share an inherent credit assignment problem: they rely on final task outcomes as feedback, but such outcomes conflate plan quality with execution errors and environmental factors, so the accumulated planning experience is often biased and noisy. To address this problem, we propose Credit-Aware Hierarchical Memory Evolution (CHIME), a self-evolving memory framework that maintains a separate planning bank and execution bank and follows an attribute-before-memorize principle: CHIME first attributes each task outcome to the plan, the execution, both, or neither, and then updates only the corresponding memory bank. Extensive experiments on four long-horizon agent benchmarks show that CHIME consistently outperforms state-of-the-art training-based and self-evolving memory baselines. Further analyses reveal several interesting findings. For example, CHIME accumulates effective memory with far fewer items. In addition, the learned memory values faithfully reflect downstream utility: high-quality planning memories are more valuable than execution memories. Finally, the accumulated memory effectively transfers across backbone models. Code will be released at https://github.com/ATH-MaaS/Marco-DeepResearch.

智能体规划自进化记忆信用分配长时程任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。