arXiv:2602.05728cs.CLcs.AI2026-02

将多跳问答的检索与推理分离,大幅减少大模型调用次数。

CompactRAG: Reducing LLM Calls and Token Overhead in Multi-Hop Question Answering

  • 离线构建细粒度问答库,线上仅需两次大模型调用
  • 在三数据集上准确率媲美基线,令牌消耗降低超60%
  • 适合资源受限场景下的高效多跳问答应用

检索增强生成(RAG)已成为知识密集型问答的关键范式。然而,现有多跳RAG系统效率低下,因在每一步交替进行检索与推理,导致重复调用大模型、令牌消耗高且实体定位不稳定。我们提出CompactRAG,一种简单而有效的框架,将离线文档重构与在线推理解耦。离线阶段,大模型读取全文一次,将其转化为原子级问答知识库,以最小、细粒度的问答对表示知识。在线阶段,复杂查询被分解并重写以保持实体一致性,通过密集检索结合RoBERTa进行答案提取。值得注意的是,推理时大模型仅被调用两次——一次用于子问题分解,一次用于最终答案合成——无论推理跳数多少。在HotpotQA、2WikiMultiHopQA和MuSiQue上的实验表明,CompactRAG在保持竞争性准确率的同时,显著降低了令牌消耗,证明其是一种成本高效且实用的大型知识库多跳推理方法。代码已开源。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) has become a key paradigm for knowledge-intensive question answering. However, existing multi-hop RAG systems remain inefficient, as they alternate between retrieval and reasoning at each step, resulting in repeated LLM calls, high token consumption, and unstable entity grounding across hops. We propose CompactRAG, a simple yet effective framework that decouples offline corpus restructuring from online reasoning. In the offline stage, an LLM reads the corpus once and converts it into an atomic QA knowledge base, which represents knowledge as minimal, fine-grained question-answer pairs. In the online stage, complex queries are decomposed and carefully rewritten to preserve entity consistency, and are resolved through dense retrieval followed by RoBERTa-based answer extraction. Notably, during inference, the LLM is invoked only twice in total - once for sub-question decomposition and once for final answer synthesis - regardless of the number of reasoning hops. Experiments on HotpotQA, 2WikiMultiHopQA, and MuSiQue demonstrate that CompactRAG achieves competitive accuracy while substantially reducing token consumption compared to iterative RAG baselines, highlighting a cost-efficient and practical approach to multi-hop reasoning over large knowledge corpora. The implementation is available at GitHub.

多跳问答RAG优化大模型降耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。