arXiv:2606.10616cs.AI2026-06被引 2

让语言智能体学会在有限记忆中优先保留有用信息,避免遗忘关键内容。

Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agents

论文配图:Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agents
图 1 · 摘自论文原文
  • 基于约束优化设计记忆保留策略,兼顾短期收益与长期代价。
  • 在紧预算下表现优于传统方法,提升信息召回率和准确率。
  • 适合长期决策类应用,如智能助手、复杂任务规划系统。

长时语言智能体累积的观察、推理轨迹和检索事实超出上下文窗口,导致记忆保留成为核心资源分配问题。现有系统将保留视为局部决策,未建模可观测性约束下的长期后果。为此,我们提出一个带预算可行性、证据效用和延迟成本(遗漏、重获、过时惩罚)的约束随机优化框架。该多步问题被证明是NP难,精确求解不可行;且部署需在部分可观测条件下进行。我们提出OSL-MR框架,严格分离在线可观测特征与离线监督信号。其结合从实际证据训练的证据学习器与混合得分启发式作为可部署的在线安全基线和归纳先验。策略从交互数据学习查询相关的证据,可在相同约束下部署。在LoCoMo和LongMemEval上的实验表明,OSL-MR优于基于时效性、生成式代理及其他启发式基线,尤其在紧预算下。混合得分先验提升精度与召回率,敏感性分析显示对成本设置具有鲁棒性。小规模可解实例中,单步优化无法预见未来需求变化,而OSL-MR显著更接近动态规划最优解,验证了序列化建模的必要性,强化了学习引导近似方案的有效性。这些结果确立了约束随机优化与优化引导学习作为长时程智能体记忆管理的理论基础。

原文摘要 · Abstract (English)

Long-horizon language agents accumulate observations, reasoning traces, and retrieved facts exceeding context windows, making memory retention a fundamental resource-allocation problem. Existing systems treat retention as local and do not model long-term consequences under observability constraints. To fill this gap, we formulate memory retention as a constrained stochastic optimization with budget feasibility, evidence utility, and delayed costs including miss, reacquisition, and stale penalties. We show this multi-step problem is NP-hard, making exact solution intractable. Moreover, deployment decisions must be made under partial observability. To address these challenges, we propose OSL-MR (Observability-Safe Learning for Memory Retention), a learning-augmented framework that enforces a strict separation between online-observable features and offline-available supervision. OSL-MR combines an evidence learner trained from realized evidence with a Mixed-Score heuristic that serves as a deployable online-safe baseline and an inductive prior. The policy learns query-conditioned evidence from interaction data and remains deployable under the same constraints. Experiments on LoCoMo and LongMemEval show OSL-MR outperforms recency-based, Generative Agents-style, and other heuristic baselines, especially under tight budgets. The Mixed-Score prior improves precision and recall, and sensitivity analysis shows robustness across cost settings. On small solvable instances, single-step optimization is insufficient to anticipate future demand shifts, while OSL-MR stays significantly closer to the dynamic-programming optimum, confirming the necessity of the sequential formulation and reinforcing our learning-guided approximation. These results establish constrained stochastic optimization and optimization-guided learning as a principled foundation for memory management in long-horizon agents.

记忆管理智能体优化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。