分两阶段定位长文档中的图文证据,提升视觉问答准确率。
HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answering

- 先选关键页再选页内区域,两级协同定位证据。
- 相比仅用页面的系统,准确率提升5.51%,F1提升4.82%。
- 适合需要细粒度图文理解的长文档问答任务。
多页文档视觉问答需在页面和区域两个层级定位稀疏证据。现有方法通常侧重单一层级:页面中心方法关注页面获取,区域操作仅作导航;区域中心方法则假设相关页面已知。因此,页面与区域选择彼此脱节。本文提出HierDoc,一种分层证据路由框架,将长文档证据获取建模为从页面到区域的两阶段集合预测。首先由页面策略从全文中选择证据页,随后解析其语义元素,再由区域策略选出传递给下游答案模型的元素。两个无答案依赖的策略通过粒度特异性结构化集奖励,采用阶段式GRPO进行优化。答案模型接收选定的完整页面及区域裁片、OCR或表格文本,兼顾全局上下文与细粒度证据。在多个基准测试中,HierDoc在开放权重系统中达到领先或竞争性表现,相较最强公开基线,LongDocURL指标提升16.87%。受控消融实验进一步表明,引入区域证据使仅使用页面的系统在准确率和F1上分别提升5.51%和4.82%。结果验证了将粗粒度页面路由与细粒度区域路由作为统一证据获取过程的连续、独立优化阶段的有效性。
原文摘要 · Abstract (English)
Multi-page document visual question answering requires locating sparse evidence at both the page and region levels. Existing approaches typically emphasize one level over the other: page-centric methods focus on page acquisition, with region operations serving mainly as navigation aids, whereas region-centric methods assume that the relevant pages have already been supplied. Consequently, page and region selection remain disconnected rather than forming successive evidence decisions. We propose HierDoc, a hierarchical evidence-routing framework that formulates long-document evidence acquisition as two-stage set prediction from pages to regions. A page policy selects evidence pages from the full document; these pages are then parsed for semantic elements, after which a region policy selects the elements passed to a downstream answer model. Both answer-agnostic policies are optimized with stage-wise GRPO using granularity-specific structured-set rewards. The answer model receives selected full pages together with selected region crops and OCR or table text, preserving global context while emphasizing fine-grained evidence. Across the evaluated benchmarks, HierDoc achieves state-of-the-art or competitive performance among open-weight systems, improving LongDocURL by 16.87% relative to the strongest reported open-weight baseline. Controlled ablations further show that selected regional evidence improves the page-only system in accuracy and F1 by 5.51% and 4.82%, respectively. These results demonstrate the benefit of organizing coarse page routing and fine-grained region routing as successive, separately optimized stages of a unified evidence-acquisition process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。