通过智能排序和动态预算,让少选更高效,提升RAG召回率
Less can be More: Relieving RAG Bottlenecks via Evidence Frontloading and Pressure-Adaptive Budgeting

- 先按证据覆盖度排序文档,优先选关键信息
- 高负载时减少重排数量,降低延迟30%以上
- 适合需要低延迟的实时问答系统
现有RAG优化多聚焦下游生成环节,但实际瓶颈可能随负载变化在上游重排与下游生成间转移。本文首次实证揭示此动态瓶颈现象:高查询率或大重排预算下,上游重排成为主要瓶颈。减少重排预算虽能缓解,却可能导致支持证据丢失、召回下降。为此提出PACE框架——无需训练,融合证据前置排序与压力自适应预算机制。首先基于边际证据覆盖度对候选文档排序,确保查询相关、互补且利于多跳推理;该目标为单调子模函数,贪心算法保证(1-1/e)近似率。随后根据重排器与LLM的相对压力动态调整重排数量。三组多跳问答数据集及线上模拟测试表明,PACE显著提升证据召回率,在重排密集型负载下降低p95延迟。关键发现:精简但高密度的前段候选可实现更高最终召回,验证‘少即是多’。
原文摘要 · Abstract (English)
Existing methods for improving Retrieval-Augmented Generation (RAG) efficiency mainly optimize downstream LLM generation, such as context compression or serving optimization. However, RAG is an end-to-end system, and its bottleneck can shift between upstream reranking and downstream generation under different serving loads and reranking budgets.In this paper, we first empirically characterize this shifting-bottleneck behavior and show that upstream reranking can become the dominant bottleneck under high query rates or large reranking budgets. Reducing the reranking budget can relieve this bottleneck, but it may also drop supporting evidence and degrade recall. To address this problem, we propose \textbf{\textsf{PACE}} (\textbf{P}rioritized \textbf{A}daptive \textbf{C}overage of \textbf{E}vidence), a training-free framework that combines \textit{evidence frontloading} with \textit{pressure-adaptive budgeting}. \textsf{PACE} first reorders candidates by marginal evidence coverage, prioritizing documents that are query-relevant, complementary, and useful for forming multi-hop evidence chains. We show that this objective is monotone submodular, giving greedy selection a $(1-1/e)$ approximation guarantee. \textsf{PACE} then dynamically adjusts the reranking budget according to the relative pressure of the reranker and the LLM. Experiments on three multi-hop QA datasets and online serving simulations show that \textsf{PACE} improves evidence recall, reduces p95 latency under ranking-heavy workloads. More importantly, the two components together reveal that \textit{less can be more}: an evidence-dense top-ranked candidates enable higher final recall with fewer reranked documents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。