用图结构组织检索结果,让大模型更好理解跨表文推理链。
N2N-GQA: Noise-to-Narrative for Graph-Based Table-Text Question Answering Using LLMs
- 将检索到的文档构建成带语义关系的动态证据图。
- 在OTT-QA上比基线高19.9点EM,达48.80,接近最优模型。
- 零样本设计,无需微调,适合快速部署多跳问答系统。
在混合表文数据上进行多跳问答需要从大规模语料中检索并推理多个证据片段,但标准检索增强生成(RAG)管道将文档处理为扁平排序列表,导致检索噪声干扰推理链条。我们提出N2N-GQA,据我们所知,这是首个面向开放域混合表文问答的零样本框架,能从噪声检索输出构建动态证据图。核心思想是:多跳推理依赖于证据间的关联性;通过将文档视为节点、语义关系作为边,可识别连接推理步骤的桥梁文档,这是列表式检索无法实现的能力。在OTT-QA上,基于图的证据整理使准确率(EM)相比强基线提升19.9点,达到48.80,接近微调模型(CORE: 49.0 EM)和高度优化系统(COS: 56.9 EM),且无需任何任务特定训练。这证明结构化图组织证据对可扩展的零样本多跳问答至关重要,且简单可解释的图构建方法可媲美复杂微调方案。
原文摘要 · Abstract (English)
Multi-hop question answering over hybrid table-text data requires retrieving and reasoning across multiple evidence pieces from large corpora, but standard Retrieval-Augmented Generation (RAG) pipelines process documents as flat ranked lists, causing retrieval noise to obscure reasoning chains. We introduce N2N-GQA. To our knowledge, it is the first zeroshot framework for open-domain hybrid table-text QA that constructs dynamic evidence graphs from noisy retrieval outputs. Our key insight is that multi-hop reasoning requires understanding relationships between evidence pieces: by modeling documents as graph nodes with semantic relationships as edges, we identify bridge documents connecting reasoning steps, a capability absent in list-based retrieval. On OTT-QA, graph-based evidence curation provides a 19.9-point EM improvement over strong baselines, demonstrating that organizing retrieval results as structured graphs is critical for multihop reasoning. N2N-GQA achieves 48.80 EM, matching finetuned retrieval models (CORE: 49.0 EM) and approaching heavily optimized systems (COS: 56.9 EM) without any task specific training. This establishes graph-structured evidence organization as essential for scalable, zero-shot multi-hop QA systems and demonstrates that simple, interpretable graph construction can rival sophisticated fine-tuned approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。