融合早融合与晚融合优势,提升表格文本检索的精准与推理能力。
HELIOS: Harmonizing Early Fusion, Late Fusion, and LLM Reasoning for Multi-Granular Table-Text Retrieval
- 基于边的二分图检索,细粒度匹配表格段落与文本
- 查询相关节点扩展,动态补全关键信息,避免遗漏
- 星型图上进行大模型逻辑推理,支持多跳聚合任务
表格-文本检索旨在为开放域问答任务召回相关表格与文本。现有方法采用早期或晚期融合,但各有局限:早期融合将表格行与其关联段落预对齐形成“星型结构”,常包含无关上下文并忽略查询依赖关系;晚期融合分别检索独立节点,可动态对齐,但易遗漏相关上下文。两者在列级聚合、多跳推理等高级任务中表现不佳。为此,我们提出HELIOS,结合两者优势:首先通过基于边的二分图检索识别表格片段与段落间的细粒度连接,有效避免无关上下文;其次通过查询相关节点扩展,动态检索关键边以扩展二分图子图,降低遗漏风险;最后在星型图层面进行大模型逻辑推理,支持复杂推理任务。实验表明,HELIOS在OTT-QA基准上相较当前最优模型,召回率和nDCG分别提升42.6%和39.9%。
原文摘要 · Abstract (English)
Table-text retrieval aims to retrieve relevant tables and text to support open-domain question answering. Existing studies use either early or late fusion, but face limitations. Early fusion pre-aligns a table row with its associated passages, forming "stars," which often include irrelevant contexts and miss query-dependent relationships. Late fusion retrieves individual nodes, dynamically aligning them, but it risks missing relevant contexts. Both approaches also struggle with advanced reasoning tasks, such as column-wise aggregation and multi-hop reasoning. To address these issues, we propose HELIOS, which combines the strengths of both approaches. First, the edge-based bipartite subgraph retrieval identifies finer-grained edges between table segments and passages, effectively avoiding the inclusion of irrelevant contexts. Then, the query-relevant node expansion identifies the most promising nodes, dynamically retrieving relevant edges to grow the bipartite subgraph, minimizing the risk of missing important contexts. Lastly, the star-based LLM refinement performs logical inference at the star graph level rather than the bipartite subgraph, supporting advanced reasoning tasks. Experimental results show that HELIOS outperforms state-of-the-art models with a significant improvement up to 42.6\% and 39.9\% in recall and nDCG, respectively, on the OTT-QA benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。