arXiv:2605.29606cs.AIcs.IR2026-05ACL被引 2

用分层结构提升文档问答的检索精度,解决找错文档和证据碎片化问题。

HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering

论文配图:HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
图 1 · 摘自论文原文
  • 构建文档层级图,通过父子关系实现从粗到细的分层检索
  • 在多个基准上提升检索召回率12.9%,端到端问答性能提升6.8%
  • 适合处理大规模工业文档中的多模态信息整合任务

面向大规模工业语料的文档型开放域问答(ODQA),检索增强生成(RAG)面临两大瓶颈:定位错误文档的路由失败,以及在有限令牌预算下难以整合分散的多模态证据。现有方法依赖扁平文本块或页面级图像,难以精确从数千候选中定位目标文档,也难以自然关联表格、图表等多模态内容。为此,我们提出HiKEY,一种基于分层树状结构的多模态检索框架,将文档层级作为首要检索信号。通过文档层级解析(DHP)重建逻辑异构图,显式编码父-子关系。采用分层粗到精策略:(1) 利用层级索引进行全局路由,快速缩小搜索空间;(2) 通过多模态融合策略对章节进行细粒度排序,捕捉最具判别性的证据。最后,采用混合结构-语义打包策略组装高效证据子图。在多个ODQA基准上的实验表明,HiKEY显著优于基于页面和文本块的基线,检索召回率最高提升12.9%,端到端问答性能最高提升6.8%。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) for document-based Open-domain Question Answering (ODQA) on large-scale industrial corpora faces two critical bottlenecks: routing failure in locating the correct document and evidence fragmentation in integrating scattered information. Existing approaches relying on flat text chunks or page-level images inherently struggle to (i) precisely pinpoint the target document among thousands of candidates and (ii) organically connect multimodal evidence, such as tables and figures, within a limited token budget. To address these challenges, we propose HiKEY, a hierarchical tree-based multimodal retrieval framework that elevates document hierarchy to a first-class retrieval signal. Instead of simple chunking, HiKEY reconstructs a logical heterogeneous graph via Document Hierarchical Parsing (DHP), explicitly encoding parent-child relationships. Adopting a hierarchical coarse-to-fine strategy, the framework (1) performs global routing to rapidly prune the search space using hierarchical indexing, and (2) conducts fine-grained retrieval to rank sections by employing a multimodal fusion strategy that captures the most discriminative evidence. Finally, HiKEY assembles a token-efficient evidence subgraph via a hybrid structural-semantic packing strategy. Experiments on ODQA benchmarks demonstrate that HiKEY significantly outperforms page- and chunk-based baselines, improving retrieval recall by up to 12.9% and end-to-end QA performance by up to 6.8%.

文档问答多模态检索分层结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。