arXiv:2504.16787cs.CLcs.AI2025-04被引 15

提出PAR-RAG框架,提升多跳问答的推理稳定性和事实一致性。

Credible Plan-Driven RAG Method for Multi-Hop Question Answering

  • 分三阶段规划-执行-复核,结合复杂度感知选择示例以稳定推理路径。
  • 在多个基准上超越基线,复杂问题上准确率提升12.3%。
  • 适合需要可靠多跳推理的科研与工业应用,尤其关注事实准确性。

检索增强生成(RAG)在单跳问答中表现优异,但在需多步推理的多跳问答中仍受限于推理稳定性与事实一致性。现有方法通常仅解决其中一者。为此,本文提出PAR-RAG,一种受PDCA循环启发的三阶段计划-执行-复核框架。其核心为复杂度感知原则:(i) 复杂度感知示例选择,使分解粒度匹配问题难度,稳定推理轨迹;(ii) 结构化检索-阅读执行流程;(iii) 双重验证机制,在复杂度基础上动态调整验证强度——简单问题强调准确性,复杂问题确保多证据一致性。实验表明,PAR-RAG在多个基准上持续优于主流基线,消融研究证实复杂度感知规划与双重验证具有互补作用。结果表明,PAR-RAG是可靠且通用的多跳推理框架。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA, which demands both stable reasoning and factual consistency. Existing approaches often provide partial solutions, addressing either reasoning trajectory stability or factual verification, but rarely achieving both simultaneously. To bridge this gap, we propose PAR-RAG, a three-stage Plan-then-Act-and-Review framework inspired by the PDCA cycle. PAR-RAG incorporates semantic complexity as a unifying principle through three key components: (i) complexity-aware exemplar selection guides plan generation by aligning decomposition granularity with question difficulty, thereby stabilizing reasoning trajectories; (ii) execution follows a structured retrieve-then-read process; and (iii) dual verification identifies and corrects intermediate errors while dynamically adjusting verification strength based on question complexity: emphasizing accuracy for simple queries and multi-evidence consistency for complex ones. This cognitively inspired framework integrates theoretical grounding with practical robustness. Experiments across diverse benchmarks demonstrate that PAR-RAG consistently outperforms competitive baselines, while ablation studies confirm the complementary roles of complexity-aware planning and dual verification. Collectively, these results establish PAR-RAG as a robust and generalizable framework for reliable multi-hop reasoning.

多跳问答RAG推理增强事实一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。