arXiv:2608.11654cs.LG2026-08

为智能体记忆建立形式化定义,明确何时最优及如何评估。

Towards a Formal Definition of Agent Memory: Basis, Span, Optimality, and the Sequential Memory Problem

  • 将记忆视为知识基底,答案可回答性取决于覆盖程度。
  • 在容量约束下最大化预期覆盖,形成可比较的效用-容量边界。
  • 引入序列学习框架,模拟持续记忆中的真伪判断与动态优化。

尽管大模型智能体广泛使用记忆,但对其本质和最优条件仍缺乏统一的形式化定义。本文提出:记忆是知识的基底,知识是其张量范围,回答能力即覆盖问题——智能体存储从环境中提取的事件;生成算子将事件集转化为其所蕴含的知识;查询可被回答当且仅当其被基底的某项覆盖。最优记忆是在容量限制下最大化期望覆盖,其价值呈现效用-容量前沿,成为衡量记忆系统通用标准。考虑记忆中的噪声,需在覆盖与精度间权衡:写入策略必须推断内容真实性。类比生物记忆通过持续经验形成,本文构建多层级序列强化学习框架,其中记忆为状态、写入为动作、查询时的效用为延迟奖励。以荷马《奥德赛》为实例,量化了前沿、压缩区与覆盖-精度偏差。最后将现有系统置于该框架中,使‘记忆好坏’可度量,并将记忆构建与学习问题转化为具体研究命题。

原文摘要 · Abstract (English)

Despite the wide deployment of memory in large-model agents, there is no unified formal account of what a memory is or when it is optimal. This paper takes a first step toward this account. The central idea is that memory is a basis, knowledge is its span, and answerability is a coverage problem: an agent stores events extracted from a material; a generation operator turns any event set into the knowledge it entails; and a query is answerable exactly when some single item in the span covers it. The optimal memory is then the capacity-constrained maximizer of expected coverage, and its value traces a utility--capacity frontier, the common yardstick on which memory systems can be compared. Next, we consider noise in the memory and discuss coverage versus precision under it: a memory may store false claims, so the write policy must infer the truth of what it stores. Drawing an analogy with biological memory, which is formed continuously through ongoing experience, we formalize the continual agent-memory problem in a sequential MDP that covers multiple levels, where memory is the state, writing is the action, and the utility settled at query time is the delayed reward that drives learning. To make the framework concrete, we instantiate it on Homer's \emph{Odyssey}, turning the frontier, the compression zone, and the divergence of coverage from precision into concrete numbers. Finally, we position existing systems within the framework, making ``how good is a memory'' measurable and recasting the open problems of constructing and learning agent memory as concrete research questions.

智能体记忆形式化定义序列学习效用-容量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。