让聊天机器人主动导航记忆,而非被动查找。
From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space

- 将用户记忆按粒度分层构建为可链接的金字塔结构。
- 在多个任务上表现优于传统方法,且保持通用推理能力。
- 适合需要长期记忆的个性化对话系统研究者。
长期用户记忆对个性化对话代理至关重要,但许多记忆系统仍通过被动检索接口暴露信息,使模型仅作为预选证据的消费者。我们提出NapMem框架,将长期用户记忆视为可操作的结构化动作空间,而非被动获取的上下文。NapMem将用户历史组织成一个包含原始对话、输入的记忆记录、话题轨迹和用户画像的多粒度记忆金字塔,通过溯源关系连接各层级,并通过记忆工具暴露这些层级。代理通过记忆工具选择与查询和中间证据匹配的记忆层级,在回答前进行多粒度检查。在PersonaMem-v2、LongMemEval和LoCoMo上的实验表明,使用记忆工具强化学习训练的NapMem代理在多种内存密集型任务中表现优异,非记忆任务评估显示其学习策略仍保留了良好的通用推理与工具使用能力。额外分析考察了存储、推理开销、工具使用行为及导航、记忆粒度与强化学习训练的消融。结果表明,长期用户记忆需结合结构化存储与可学习的使用策略,以在适当粒度下高效利用。
原文摘要 · Abstract (English)
Long-term user memory is essential for personalized conversational agents, yet many memory systems still expose memory through passive retrieval interfaces, making the model a consumer of pre-selected evidence. We introduce NapMem, a framework for learning to use long-term user memory as a structured action space rather than passively retrieved context. NapMem organizes user history into a linked multi-granularity memory pyramid, where raw conversations, typed memory records, topic tracks, and user profiles are connected through provenance relations, and exposes these levels through memory tools. The agent is trained to select memory according to the query and intermediate evidence, allowing it to inspect different memory granularities before answering. Experiments on PersonaMem-v2, LongMemEval, and LoCoMo show that a NapMem agent trained with memory-tool reinforcement learning is competitive across diverse memory-intensive tasks, while evaluations on non-memory tasks suggest that the learned policy largely preserves general reasoning and tool-use abilities. Additional analyses examine storage, inference cost, tool-use behavior, and ablations over navigation, memory granularity, and RL training. Our results suggest that long-term user memory benefits from coupling structured storage with a learned policy for using memory at the appropriate granularity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。