arXiv:2606.10694cs.CL2026-06被引 2

用带时间与置信度的图结构,让大模型长期记忆更准更稳。

REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs

论文配图:REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs
图 1 · 摘自论文原文
  • 构建带时间、置信度和意图标签的动态知识图谱存储记忆
  • 通过非破坏性更新保留事实演变过程,提升记忆完整性
  • 支持反事实推理修复错误检索,适合需要长期对话的场景

大型语言模型(LLMs)需在长时间交互中维持记忆,但受限于上下文窗口,无法存储全部历史信息。现有记忆系统存在三大缺陷:扁平文本组织难以捕捉记忆间关系;结构化系统常破坏性覆盖演化中的事实;检索机制缺乏主动修正能力。REAL将长期对话记忆建模为时序与置信度感知的有向属性图,每个基本事实包含实体、关系、有效时间区间、置信度分数及探索意图标签。记忆构建采用非破坏性时序更新策略,保留并行事实版本及其有效区间,准确追踪事实演变。检索阶段,锚定查询相关根实体,解耦探索意图,通过语义评估器引导的混合束搜索提取紧凑子图,并引入反事实推理修复不可靠检索状态,利用隐含逻辑关系恢复缺失证据。大量实验表明,相比扁平文本、图结构及现有记忆基线,REAL平均性能提升22.72%。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly expected to interact with users over long time horizons. However, due to their finite context window, LLMs cannot retain all past interactions, making long-term memory management essential for storing, updating, and retrieving historical information beyond the context limit. Although recent memory systems attempt to address this issue by storing historical information externally, existing approaches suffer from three key limitations: flat text-based memory organizations fail to capture explicit relations among memories, structured memory systems often destructively overwrite evolving facts, and current retrieval mechanisms remain query-agnostic and passive when evidence is incomplete. REAL constructs long-term conversational memory as a temporal and confidence-aware directed property graph, where each atomic fact is represented with entities, relations, valid-time intervals, confidence scores, and exploration intent labels. During memory construction, REAL adopts a non-destructive temporal update strategy that preserves parallel fact versions and their validity intervals, enabling faithful tracking of fact evolution. During retrieval, REAL anchors query-relevant root entities, decouples their exploration intents, and performs semantic evaluator-guided hybrid beam search to extract compact memory subgraphs. It further incorporates counterfactual inference to repair unreliable retrieval states and recover missing memory evidence through implicit logical relations. Comprehensive experiments demonstrate that REAL substantially improves long-term memory performance over flat-text, graph-based, and existing memory baselines, achieving an average improvement of 22.72\%.

长时记忆知识图谱大模型推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。