arXiv:2604.20117cs.CL2026-04被引 1

用认知框架约束生成,让智能体记忆更准不乱编。

To Know is to Construct: Schema-Constrained Generation for Agent Memory

论文配图:To Know is to Construct: Schema-Constrained Generation for Agent Memory
图 1 · 摘自论文原文
  • 用动态认知框架限制生成,只允许合法记忆键出现
  • 在LoCoMo基准上全面超越传统检索方法
  • 适合需要长期可靠记忆的复杂推理任务

建构主义认识论认为知识是主动构建而非被动复制。尽管大语言模型具有生成能力,现有智能体记忆系统仍依赖密集检索,但密集检索严重依赖句内语义重叠或实体匹配,导致语义相似但上下文不同的条目难以区分,引入大量噪声。相反,直接使用开放式生成进行记忆访问可能引发“结构幻觉”,即模型生成不存在的记忆键,造成查找失败。受此启发,我们提出记忆本质上由认知框架组织,有效回忆必须是在这些框架内的生成过程。为此,我们设计了SCG-MEM,一种基于认知框架的生成式记忆架构。通过将记忆访问重构为“框架约束生成”,并维护动态认知框架,严格限制LLM解码仅生成合法记忆键,形式化保证避免结构幻觉。为支持长期适应,我们建模记忆更新为同化(将输入融入现有框架)与顺应(以新概念扩展框架)。此外,构建关联图实现多跳推理。在LoCoMo基准上的实验表明,SCG-MEM在所有类别上均显著优于基于检索的基线。

原文摘要 · Abstract (English)

Constructivist epistemology argues that knowledge is actively constructed rather than passively copied. Despite the generative nature of Large Language Models (LLMs), most existing agent memory systems are still based on dense retrieval. However, dense retrieval heavily relies on semantic overlap or entity matching within sentences. Consequently, embeddings often fail to distinguish instances that are semantically similar but contextually distinct, introducing substantial noise by retrieving context-mismatched entries. Conversely, directly employing open-ended generation for memory access risks "Structural Hallucination" where the model generates memory keys that do not exist in the memory, leading to lookup failures. Inspired by this epistemology, we posit that memory is fundamentally organized by cognitive schemas, and valid recall must be a generative process performed within these schematic structures. To realize this, we propose SCG-MEM, a schema-constrained generative memory architecture. SCG-MEM reformulates memory access as Schema-Constrained Generation. By maintaining a dynamic Cognitive Schema, we strictly constrain LLM decoding to generate only valid memory entry keys, providing a formal guarantee against structural hallucinations. To support long-term adaptation, we model memory updates via assimilation (grounding inputs into existing schemas) and accommodation (expanding schemas with novel concepts). Furthermore, we construct an Associative Graph to enable multi-hop reasoning through activation propagation. Experiments on the LoCoMo benchmark show that SCG-MEM substantially improves performance across all categories over retrieval-based baselines.

记忆机制认知框架生成式记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。