让智能体主动记忆关键信息,解决长任务中决策失效问题
Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents

- 用独立记忆代理主动维护结构化记忆库,选择性提醒关键状态
- 在两个基准上分别提升8.3和6.8个百分点的通过率
- 适用于各类强化学习智能体,特别适合长周期任务研究者
在长周期任务中,重要状态常被分散在不断扩展的轨迹中,而执行智能体需从中提取并决策。随着轨迹增长,任务要求、环境事实、过往尝试、诊断结果和未完成子目标可能被挤出上下文窗口或超出其范围,导致关键时刻无法影响行为,我们称之为“行为状态衰减”。本文将记忆视为主动干预机制而非被动检索。一个独立的内存代理与未修改的动作智能体并行运行,从近期轨迹更新结构化记忆库,并决定是否注入基于记忆的提醒或保持沉默。该模块可即插即用,兼容前沿动作智能体及现有智能体框架。在Terminal-Bench 2.0和$τ^2$-Bench上,对较弱和较强的行动智能体均提升pass@1,分别取得+8.3和+6.8个百分点的增益。消融实验表明,选择性干预优于被动暴露、持续注入、仅顾问引导和通用检索。作为开放权重记忆策略的初步探索,我们使用SFT和GRPO在SETA上训练Qwen3.5-27B,提升了验证奖励,并实现部分跨任务迁移至Terminal-Bench。
原文摘要 · Abstract (English)
In long-horizon tasks, decision-relevant state is often scattered across an expanding trajectory, while the action agent must surface it and act. As trajectories grow, task requirements, environment facts, prior attempts, diagnoses, and open subgoals can be buried in the context window or pushed beyond it, failing to influence decisions when needed. We call this failure mode "behavioral state decay". We study memory as an active intervention mechanism rather than passive retrieval. A separate memory agent runs alongside an unmodified action agent, updating a structured memory bank from the recent trajectory and deciding whether to inject a memory-grounded reminder or remain silent. The module is plug-and-play with frontier action agents and existing agent harnesses. Across Terminal-Bench 2.0 and $τ^2$-Bench, it improves pass@1 for both weaker and stronger action agents, with gains of +8.3 pp on Terminal-Bench and +6.8 pp on $τ^2$-Bench. Ablations show that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, and general retrieval. As an early step toward open-weight memory policies, we train Qwen3.5-27B on SETA using SFT and GRPO, improving validation reward and achieving partial transfer to Terminal-Bench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。