arXiv:2606.25161cs.AI2026-06

让大模型记忆更可信,减少遗忘、篡改和幻觉。

TRUSTMEM: Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory

论文配图:TRUSTMEM: Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory
图 1 · 摘自论文原文
  • 用验证器评估记忆更新的覆盖、保留和真实度
  • 通过偏好学习优化记忆操作,提升准确率12.14点
  • 适合需要长期可靠记忆的智能体应用

大语言模型代理依赖长期记忆实现超上下文窗口的持续交互与个性化服务。现有记忆代理通过生成写入、修改和删除操作主动更新外部记忆,但这些更新可能遗漏重要信息、破坏已有记忆或引入无依据的幻觉内容。一旦存储,此类错误会成为持久的系统状态故障,影响后续推理与生成。本文提出TrustMem框架,旨在提升记忆整合的可信度。TrustMem采用记忆转换验证器,从覆盖性、保留性和忠实性三个维度评估记忆更新过程。同时,在同一记忆状态下构建候选更新的偏好对,支持偏好引导的强化学习,直接优化记忆更新行为。大量实验表明,TrustMem在记忆效用与可靠性上均显著提升:在MemoryAgentBench、HaluMem及Mem-alpha验证集上达到当前最佳表现,使HaluMem记忆提取的F1值提升12.14点,相较于各误差类型最强基线,过渡层面的遗漏、篡改和幻觉分别降低40.1%、79.1%和50.0%。

原文摘要 · Abstract (English)

Large language model (LLM) agents rely on long-term memory to support extended interactions and personalized assistance beyond finite context windows. Existing memory agents actively update external memory through generated write, revise, and delete operations, but these updates may omit important information, corrupt existing memory, or introduce unsupported hallucinated content. Once stored, such errors become persistent system-state failures that can affect future reasoning and generation. In this paper, we propose TrustMem, a framework designed to improve the trustworthiness of memory consolidation. TrustMem relies on a Memory Transition Verifier to evaluate the transition process of memory updates in terms of coverage, preservation, and faithfulness. It further constructs preference pairs among candidate updates under the same memory state, enabling preference-guided reinforcement learning to directly optimize memory updating behaviors. Extensive experiments demonstrate that TrustMem improves both memory utility and reliability: it achieves state-of-the-art results across MemoryAgentBench, HaluMem, and the Mem-alpha validation set, improves HaluMem memory extraction by 12.14 F1 points, and reduces transition-level omission, corruption, and hallucination by 40.1\%, 79.1\%, and 50.0\%, respectively, compared with the strongest baseline for each error type.

大模型记忆系统可信生成强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。