用决策理论优化大模型记忆管理,让记忆选择更智能。
Beyond Heuristics: A Decision-Theoretic Framework for Agent Memory Management
- 将记忆管理看作不确定性下的序列决策问题
- 通过价值函数评估操作的长期收益与风险
- 为未来构建抗不确定性的记忆系统打基础
外部记忆是现代大语言模型系统的关键组件,支持长期交互与个性化。然而,当前记忆管理仍依赖人工设计的启发式规则,难以预见记忆决策对未来的检索及下游行为的影响。我们提出一种基于决策理论的框架DAM(Decision-theoretic Agent Memory),将记忆管理分解为即时信息访问与分层存储维护。候选操作通过价值函数与不确定性估计器评估,由聚合策略根据预估的长期效用与风险做出决策。本工作并非提出新算法,而是从原理上重新定义记忆管理,揭示启发式方法的局限性,并为未来不确定性感知的记忆系统研究提供基础。
原文摘要 · Abstract (English)
External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering little insight into the long-term and uncertain consequences of memory decisions. In practice, choices about what to read or write shape future retrieval and downstream behavior in ways that are difficult to anticipate. We argue that memory management should be viewed as a sequential decision-making problem under uncertainty, where the utility of memory is delayed and dependent on future interactions. To this end, we propose DAM (Decision-theoretic Agent Memory), a decision-theoretic framework that decomposes memory management into immediate information access and hierarchical storage maintenance. Within this architecture, candidate operations are evaluated via value functions and uncertainty estimators, enabling an aggregate policy to arbitrate decisions based on estimated long-term utility and risk. Our contribution is not a new algorithm, but a principled reframing that clarifies the limitations of heuristic approaches and provides a foundation for future research on uncertainty-aware memory systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。