arXiv:2605.10268cs.CLcs.AI2026-05

通过记忆引导重读,提升长文本推理的准确性和效率。

MemReread: Enhancing Agentic Long-Context Reasoning via Memory-Guided Rereading

论文配图:MemReread: Enhancing Agentic Long-Context Reasoning via Memory-Guided Rereading
图 1 · 摘自论文原文
  • 基于流式阅读,用记忆触发重读而非中间检索。
  • 在记忆不足时自动分解问题并重读,恢复被丢弃的间接信息。
  • 支持灵活控制计算开销,适合复杂长文本任务。

为解决标准注意力机制带来的二次复杂度问题,基于代理记忆的方法已出现,通常在线性处理文档片段时动态更新记忆。为缓解记忆覆盖导致的潜在证据丢失,近期工作引入检索模块以召回此前丢弃的信息。然而,基于检索的召回存在记忆形成阶段的证据损失及无效查询引发的干扰。为此,我们提出MemReread。其基于流式阅读,绕过中间检索,在最终记忆不足时触发问题分解与重读,从而恢复早期被丢弃的间接事实。该设计支持非线性推理,同时保持文档理解的自然逻辑流。为进一步提升实用性,我们引入强化学习框架,在动态确定重读次数的同时增强长度外推能力,灵活控制计算开销。大量实验表明,MemReread在长上下文推理任务中持续优于基线框架,且时间复杂度与上下文长度呈线性关系。

原文摘要 · Abstract (English)

To tackle long-context reasoning tasks without the quadratic complexity of standard attention mechanisms, approaches based on agent memory have emerged, which typically maintain a dynamically updated memory when linearly processing document chunks. To mitigate the potential loss of latent evidence in this memorize-while-reading paradigm, recent works have integrated retrieval modules that allow agents to recall information previously discarded during memory overwriting. However, retrieval-based recall suffers from both evidence loss during memory formation and interference induced by invalid queries. To overcome these limitations, we propose MemReread. Built upon streaming reading, MemReread circumvents intermediate retrieval. It triggers question decomposition and rereading when the final memory is insufficient, enabling the recovery of indirect facts that were prematurely discarded. This design supports non-linear reasoning while preserving the inherent logical flow of document comprehension. To further enhance practicality, we introduce a reinforcement learning framework that enhances length extrapolation capability while dynamically determining the number of rereading passes based on task complexity, thereby flexibly controlling computational overhead. Extensive experiments demonstrate that MemReread consistently outperforms baseline frameworks on long-context reasoning tasks, while maintaining linear time complexity with respect to context length.

长文本推理记忆机制重读策略强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。