arXiv:2506.00232cs.CL2025-06被引 12

模块化RAG系统提升多跳问答准确率与可解释性

ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering

  • 将RAG拆解为可独立设计的原子模块,支持灵活组合与优化
  • 在多跳问答任务中比基线高15%准确率,且显著降低无依据回答
  • 适合需要透明推理和可调试系统的科研与工业应用

检索增强生成(RAG)系统日益多样化,但多数采用紧密耦合的单体设计,将查询重构、检索、推理和验证等功能捆绑在一起,限制了可解释性、系统评估和针对性改进,尤其在复杂多跳问答任务中。本文提出ComposeRAG,一种新型模块化抽象架构,将RAG流程分解为原子可组合模块,如问题分解、查询重写、检索决策和答案验证。每个模块作为对结构化输入/输出的参数化变换,支持独立实现、升级与分析。为提升多步推理鲁棒性,该系统引入自反思机制,在验证失败时迭代回溯并修正前期步骤。在四个具有挑战性的多跳问答基准上评估显示,ComposeRAG在准确率和依据保真度方面均显著优于强基线:相比微调方法最高提升15%,相比专用推理管道提升5%(相同检索条件下)。关键的是,其验证优先设计使低质量检索场景下无依据回答减少超10%,强语料下亦减少约3%。全面消融实验验证了模块架构的有效性,各组件贡献独立且可叠加。结果表明,ComposeRAG能实现灵活、透明、可扩展且高性能的多跳推理,同时提升依据可靠性和可解释性。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) systems are increasingly diverse, yet many suffer from monolithic designs that tightly couple core functions like query reformulation, retrieval, reasoning, and verification. This limits their interpretability, systematic evaluation, and targeted improvement, especially for complex multi-hop question answering. We introduce ComposeRAG, a novel modular abstraction that decomposes RAG pipelines into atomic, composable modules. Each module, such as Question Decomposition, Query Rewriting, Retrieval Decision, and Answer Verification, acts as a parameterized transformation on structured inputs/outputs, allowing independent implementation, upgrade, and analysis. To enhance robustness against errors in multi-step reasoning, ComposeRAG incorporates a self-reflection mechanism that iteratively revisits and refines earlier steps upon verification failure. Evaluated on four challenging multi-hop QA benchmarks, ComposeRAG consistently outperforms strong baselines in both accuracy and grounding fidelity. Specifically, it achieves up to a 15% accuracy improvement over fine-tuning-based methods and up to a 5% gain over reasoning-specialized pipelines under identical retrieval conditions. Crucially, ComposeRAG significantly enhances grounding: its verification-first design reduces ungrounded answers by over 10% in low-quality retrieval settings, and by approximately 3% even with strong corpora. Comprehensive ablation studies validate the modular architecture, demonstrating distinct and additive contributions from each component. These findings underscore ComposeRAG's capacity to deliver flexible, transparent, scalable, and high-performing multi-hop reasoning with improved grounding and interpretability.

RAG多跳问答模块化可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。