让大模型更高效推理,只选最关键的线索片段。
Less is More: Compact Clue Selection for Efficient Retrieval-Augmented Generation Reasoning
- 基于大模型反馈训练三阶段机制,精准提取关键线索。
- 相比基线方法,推理延迟降低37%,准确率提升1.8%。
- 适合追求低延迟与高精度的智能问答系统使用。
当前RAG检索器主要面向人类读者,注重段落完整性和可读性。然而,大语言模型(LLMs)更受益于精确、紧凑且结构良好的输入,这能提升推理质量与效率。现有方法依赖重排序或摘要来识别关键句,但可能引入语义断裂和不忠实问题。如何从大规模文档中高效提取并组织与答案相关的线索,同时降低大模型推理成本,仍是RAG系统的挑战。受奥卡姆剃刀启发,我们提出以最小化推理开销为目标的极小化-最大化优化框架:在最大化潜在线索提取与重排序组织的同时,最小化推理成本,通过截断至最小必要线索集实现。本文提出CompSelect,一种面向大模型的紧凑线索选择机制,包含线索提取器、重排序器与截断器。1)线索提取器以包含答案的句子为微调目标,旨在提取充分的潜在线索;2)重排序器基于真实大模型反馈训练,优先排序有效线索;3)截断器以最少足够线索构成的文本为微调目标,实现高效推理。在三个QA数据集上的实验表明,CompSelect在提升性能的同时,显著降低总延迟与在线延迟。进一步分析验证其对不可靠检索的鲁棒性及跨场景泛化能力。
原文摘要 · Abstract (English)
Current RAG retrievers are designed primarily for human readers, emphasizing complete, readable, and coherent paragraphs. However, Large Language Models (LLMs) benefit more from precise, compact, and well-structured input, which enhances reasoning quality and efficiency. Existing methods rely on reranking or summarization to identify key sentences, but may introduce semantic breaks and unfaithfulness. Thus, efficiently extracting and organizing answer-relevant clues from large-scale documents while reducing LLM reasoning costs remains challenging in RAG systems. Inspired by Occam's razor, we frame LLM-centric retrieval as MinMax optimization: maximizing the extraction of potential clues and reranking them for well-organization, while minimizing reasoning costs by truncating to the smallest sufficient set of clues. In this paper, we propose CompSelect, a compact clue selection mechanism for LLM-centric RAG, consisting of a clue extractor, a reranker, and a truncator. (1) The clue extractor first uses answer-containing sentences as fine-tuning targets, aiming to extract sufficient potential clues; (2) The reranker is trained to prioritize effective clues based on real LLM feedback; (3) The truncator uses the truncated text containing the minimum sufficient clues for answering the question as fine-tuning targets, thereby enabling efficient RAG reasoning. Experiments on three QA datasets demonstrate that CompSelect improves performance while reducing both total and online latency compared to a range of baseline methods. Further analysis also confirms its robustness to unreliable retrieval and generalization across different scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。