arXiv:2511.07587cs.AIcs.CL2025-11AAAI被引 7

让大模型像人一样记住事件全过程,支持长期推理。

Beyond Fact Retrieval: Episodic Memory for RAG with Generative Semantic Workspaces

论文配图:Beyond Fact Retrieval: Episodic Memory for RAG with Generative Semantic Workspaces
图 1 · 摘自论文原文
  • 用生成式语义空间构建随时间演化的事件记忆结构
  • 在百万级文本上提升20%推理准确率,查询上下文减少51%
  • 适合需要追踪事件发展、做长时推理的智能体应用

大语言模型在长序列推理中面临根本性挑战:大量文档超出其有限上下文窗口,而即使可容纳的文本也随长度增加性能下降,需依赖外部记忆框架。现有方法从语义嵌入检索进化到结构化知识图谱,但主要面向事实检索,无法构建时空锚定的叙事表征以追踪实体在事件中的演变。为此,本文提出神经启发的生成式语义空间(GSW),通过操作器将输入观测映射为中间语义结构,并由协调器将其整合为保持时空与逻辑一致性的持久工作空间,实现对角色、行为及情境的动态建模。在涵盖10万至100万词元的剧集记忆基准(EpBench)上,GSW相比现有RAG基线最高提升20%性能,同时将查询时上下文令牌减少51%,显著降低推理开销。该框架为赋予大模型类人情景记忆提供了可行路径,助力构建具备长程推理能力的智能体。代码已开源。

原文摘要 · Abstract (English)

Large Language Models (LLMs) face fundamental challenges in long-context reasoning: many documents exceed their finite context windows, while performance on texts that do fit degrades with sequence length, necessitating their augmentation with external memory frameworks. Current solutions, which have evolved from retrieval using semantic embeddings to more sophisticated structured knowledge graphs representations for improved sense-making and associativity, are tailored for fact-based retrieval and fail to build the space-time-anchored narrative representations required for tracking entities through episodic events. To bridge this gap, we propose the \textbf{Generative Semantic Workspace} (GSW), a neuro-inspired generative memory framework that builds structured, interpretable representations of evolving situations, enabling LLMs to reason over evolving roles, actions, and spatiotemporal contexts. Our framework comprises an \textit{Operator}, which maps incoming observations to intermediate semantic structures, and a \textit{Reconciler}, which integrates these into a persistent workspace that enforces temporal, spatial, and logical coherence. On the Episodic Memory Benchmark (EpBench) \cite{huet_episodic_2025} comprising corpora ranging from 100k to 1M tokens in length, GSW outperforms existing RAG based baselines by up to \textbf{20\%}. Furthermore, GSW is highly efficient, reducing query-time context tokens by \textbf{51\%} compared to the next most token-efficient baseline, reducing inference time costs considerably. More broadly, GSW offers a concrete blueprint for endowing LLMs with human-like episodic memory, paving the way for more capable agents that can reason over long horizons. Code is available at https://github.com/roychowdhuryresearch/gsw-memory.

大模型记忆长时推理RAG事件追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。