arXiv:2504.18243cs.LG2025-04ACL被引 27

DualRAG通过双流程协同,让模型推理与检索相互增强,提升多跳问答准确率。

DualRAG: A Dual-Process Approach to Integrate Reasoning and Retrieval for Multi-Hop Question Answering

  • 分两步走:先推理生成查询,再逐步整合新知识
  • 在多个数据集上接近甚至超过拥有理想知识的模型表现
  • 适合需要复杂逻辑推理的问答系统开发者

多跳问答(MHQA)广泛应用于真实场景,需在不同知识领域中完成多步推理。现有方法虽通过迭代检索改进,但仍难以动态识别和组织知识。为此,我们提出DualRAG,一种融合推理与检索的双流程协同框架。该框架包含两个紧密耦合过程:推理增强型查询(RaQ)与渐进式知识聚合(pKA)。RaQ在推理路径中生成精准查询,同时pKA将新获取的知识系统化整合,支撑连贯推理,形成知识丰富与推理优化的良性循环。通过针对性微调,DualRAG在小型模型上仍保持强大推理与检索能力,展现跨规模适用性。大量实验表明,该双流程方法显著提升答案准确率与连贯性,接近甚至在某些情况下超越使用理想知识访问的性能。结果证明DualRAG是解决复杂多跳推理任务的鲁棒高效方案。

原文摘要 · Abstract (English)

Multi-Hop Question Answering (MHQA) tasks permeate real-world applications, posing challenges in orchestrating multi-step reasoning across diverse knowledge domains. While existing approaches have been improved with iterative retrieval, they still struggle to identify and organize dynamic knowledge. To address this, we propose DualRAG, a synergistic dual-process framework that seamlessly integrates reasoning and retrieval. DualRAG operates through two tightly coupled processes: Reasoning-augmented Querying (RaQ) and progressive Knowledge Aggregation (pKA). They work in concert: as RaQ navigates the reasoning path and generates targeted queries, pKA ensures that newly acquired knowledge is systematically integrated to support coherent reasoning. This creates a virtuous cycle of knowledge enrichment and reasoning refinement. Through targeted fine-tuning, DualRAG preserves its sophisticated reasoning and retrieval capabilities even in smaller-scale models, demonstrating its versatility and core advantages across different scales. Extensive experiments demonstrate that this dual-process approach substantially improves answer accuracy and coherence, approaching, and in some cases surpassing, the performance achieved with oracle knowledge access. These results establish DualRAG as a robust and efficient solution for complex multi-hop reasoning tasks.

多跳问答推理增强知识整合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。