用分层结构提升文档问答的检索精度,解决找错文档和证据碎片化问题。
HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering

- 构建文档层级图,通过父子关系实现从粗到细的分层检索
- 在多个基准上提升检索召回率12.9%,端到端问答性能提升6.8%
- 适合处理大规模工业文档中的多模态信息整合任务
面向大规模工业语料的文档型开放域问答(ODQA),检索增强生成(RAG)面临两大瓶颈:定位错误文档的路由失败,以及在有限令牌预算下难以整合分散的多模态证据。现有方法依赖扁平文本块或页面级图像,难以精确从数千候选中定位目标文档,也难以自然关联表格、图表等多模态内容。为此,我们提出HiKEY,一种基于分层树状结构的多模态检索框架,将文档层级作为首要检索信号。通过文档层级解析(DHP)重建逻辑异构图,显式编码父-子关系。采用分层粗到精策略:(1) 利用层级索引进行全局路由,快速缩小搜索空间;(2) 通过多模态融合策略对章节进行细粒度排序,捕捉最具判别性的证据。最后,采用混合结构-语义打包策略组装高效证据子图。在多个ODQA基准上的实验表明,HiKEY显著优于基于页面和文本块的基线,检索召回率最高提升12.9%,端到端问答性能最高提升6.8%。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) for document-based Open-domain Question Answering (ODQA) on large-scale industrial corpora faces two critical bottlenecks: routing failure in locating the correct document and evidence fragmentation in integrating scattered information. Existing approaches relying on flat text chunks or page-level images inherently struggle to (i) precisely pinpoint the target document among thousands of candidates and (ii) organically connect multimodal evidence, such as tables and figures, within a limited token budget. To address these challenges, we propose HiKEY, a hierarchical tree-based multimodal retrieval framework that elevates document hierarchy to a first-class retrieval signal. Instead of simple chunking, HiKEY reconstructs a logical heterogeneous graph via Document Hierarchical Parsing (DHP), explicitly encoding parent-child relationships. Adopting a hierarchical coarse-to-fine strategy, the framework (1) performs global routing to rapidly prune the search space using hierarchical indexing, and (2) conducts fine-grained retrieval to rank sections by employing a multimodal fusion strategy that captures the most discriminative evidence. Finally, HiKEY assembles a token-efficient evidence subgraph via a hybrid structural-semantic packing strategy. Experiments on ODQA benchmarks demonstrate that HiKEY significantly outperforms page- and chunk-based baselines, improving retrieval recall by up to 12.9% and end-to-end QA performance by up to 6.8%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。