用动态记忆追踪文档证据,提升长文理解准确率
DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding

- 三重记忆结构捕捉文档结构、页面相关性与问答轨迹
- 通过贝叶斯更新与采样实现跨轮次页面选择优化
- 适合需要细粒度文档推理的复杂任务场景
长文档理解需在数百页中定位稀疏且异构的证据,但现有系统受限于静态检索和脆弱的跨轮次记忆。主流单轮方法在初始阶段固定选取前k页,难以纠正早期检索错误;近期迭代方法虽支持多轮证据获取,却未研究状态传播机制,难追踪页面相关性的动态变化。为此,我们提出DocMemo,一种基于记忆引导的框架,将长文档推理建模为动态证据探索过程。DocMemo维护三级检索状态:文档结构记忆、页面信念记忆与问题情景记忆,分别捕获结构先验、动态相关性估计与查询特定推理路径。推理过程中,通过贝叶斯页面信念更新结合汤普森采样、空间邻近传播及结构感知自适应粒度证据访问,持续优化跨轮次页面选择,并补充页面级证据至细粒度视觉区域。在3个基准上的实验表明,DocMemo达到当前最优性能,验证了结构化记忆与动态信念更新的有效性。代码已开源。
原文摘要 · Abstract (English)
Long-document understanding requires locating sparse and heterogeneous evidence across hundreds of pages, yet existing systems remain limited by static retrieval and fragile cross-round memory. Mainstream single-round methods commit to a fixed top-$k$ page set at the outset and struggle to recover from early retrieval errors; recent iterative approaches allow multi-round evidence acquisition, but they do not investigate the propagation mechanism of cross-round states, making it difficult to track the dynamic changes in page relevance. To address these limitations, we propose DocMemo, a memory-guided framework that formulates long-document reasoning as dynamic evidence exploration. DocMemo maintains a tri-level retrieval state consisting of Document Schema Memory, Page Belief Memory, and Question Episodic Memory, which respectively capture structural priors, dynamic relevance estimation, and query-specific reasoning trajectories. During reasoning, DocMemo continuously refines cross-round page selection through Bayesian page belief updating with Thompson sampling, spatial proximity propagation, and structure-aware adaptive-granularity evidence access, while supplementing page-level evidence with fine-grained visual regions. Experiments on 3 benchmarks show that DocMemo achieves state-of-the-art performance and validate the efficacy of structured memory and dynamic page belief updating. Code is available at https://github.com/Harrygof/DocMemo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。