用链式推理导航器精准拆解多跳问题,提升问答准确率。
SEARCH-R: Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator for Multi-hop Question Answering
- 训练端到端推理路径导航器,精细分解复杂问题。
- 依赖树检索量化文档信息贡献,避免无效知识获取。
- 适用于需要深度推理的开放域问答场景。
多跳问答(MHQA)旨在回答需多步推理的问题,面临两大挑战:生成正确推理路径,以及在大语言模型能力受限时准确检索关键知识。现有方法主要依赖提示工程生成推理路径,并结合传统稀疏或稠密检索得出答案,但推理路径生成缺乏有效控制,易偏离方向;检索则过度依赖匹配度或相似性评分,难以评估信息实用性,导致检索结果同质化或无用。为此,本文提出结构化实体感知检索框架 SEARCH-R,通过微调 Llama3.1-8B 模型训练端到端推理路径导航器,实现高效子问题分解;同时设计基于依赖树的检索机制,定量评估文档的信息贡献度。在三个具有挑战性的多跳数据集上的实验验证了该框架的有效性。代码与数据集已开源。
原文摘要 · Abstract (English)
Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential knowledge in the face of potential limitations in large language models (LLMs). Existing approaches primarily rely on prompt-based methods to generate reasoning paths, which are further combined with traditional sparse or dense retrieval to produce the final answer. However, the generation of reasoning paths commonly lacks effective control over the generative process, thus leading the reasoning astray. Meanwhile, the retrieval methods over-rely on knowledge matching or similarity scores rather than evaluating the practical utility of the information, resulting in retrieving homogeneous or non-useful information. Therefore, we propose a Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator framework named SEARCH-R. Specifically, SEARCH-R trains an end-to-end reasoning path navigator, which is able to provide a powerful sub-question decomposer by fine-tuning the Llama3.1-8B model. Moreover, a novel dependency tree-based retrieval is designed to evaluate the informational contribution of the document quantitatively. Extensive experiments on three challenging multi-hop datasets validate the effectiveness of the proposed framework. The code and dataset are available at: https://github.com/Applied-Machine-Learning-Lab/ACL2026_SEARCH-R.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。