通过分层推理提升长文档理解,有效避免错误信息干扰。
Hierarchical Evidence-Driven Reasoning for Long Document Understanding

- 将复杂问题拆解为多步小问题,逐步精准定位证据
- 采用多页交叉验证机制,准确率比现有模型高8.05%
- 适合需要深度推理的闭域文档分析任务
检索增强生成(RAG)通过检索机制将输入限制在高度精选的文档子集,简化长文档理解。然而现有多模态RAG系统面临两大挑战:一是标准语义相似度检索常引入主题相关但无答案的干扰页;二是单次传递管道严重依赖初始检索结果,任何关键证据遗漏都会导致连锁错误。为此,我们提出HIEVI-RAG,一种分层、证据驱动的多模态RAG框架,用于闭域文档理解。该框架将复杂查询系统性地分解为四阶段协作流程:(1) 分层问题分解,将多跳根问题拆分为原子子问题;(2) 基于多模态检索器的粗粒度页面检索,依据语义相似性获取候选页;(3) 通过EVIAGENT(一种基于GRPO训练的专用多页验证器),对多图像块执行跨页推理完成细粒度页面验证;(4) 基于记忆的迭代生成,利用累积的子问题上下文,在优先排序序列上执行多轮动态推理。在四个基准上的广泛评估表明,本框架具有显著的鲁棒性和协同效应,显著优于现有开源基线,平均准确率超越最强报告基线8.05%。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) streamlines long-document understanding by leveraging retrieval mechanisms to restrict input images to a highly curated subset. However, existing multimodal RAG pipelines primarily face two critical challenges: first, standard semantic similarity retrievers frequently fetch topically overlapping yet answer-void distractor pages that mislead downstream generation; second, rigid single-pass pipelines heavily depend on initial retrieval success, where any omission of core evidence inevitably causes cascading errors. To address these challenges, we introduce HIEVI-RAG, a hierarchical, evidence-driven multimodal RAG framework for closed-domain document understanding. HIEVI-RAG systematically factorizes complex queries into a cooperative four-stage pipeline: (1) hierarchical question decomposition to break multi-hop root queries into atomic child questions; (2) coarse visual page retrieval leveraging a multimodal retriever to fetch candidate pages based on semantic similarity; (3) fine-grained page verification via EVIAGENT, a specialized multi-page verifier trained with GRPO to execute cross-page reasoning over multi-image blocks; and (4) memory-guided iterative generation that leverages accumulated sub-question context to execute multi-round, dynamic reasoning over the prioritized sequence. Extensive evaluations across four benchmarks demonstrate the robust efficacy and synergy of our framework, which significantly outperforms existing open-source baselines and exceeds the strongest reported baseline by an average of 8.05% in accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。