arXiv:2604.15621cs.IRcs.AI2026-04

提出新框架,让模型按需检索,省资源还更准。

Rethinking the Necessity of Adaptive Retrieval-Augmented Generation through the Lens of Adaptive Listwise Ranking

论文配图:Rethinking the Necessity of Adaptive Retrieval-Augmented Generation through the Lens of Adaptive Listwise Ranking
图 1 · 摘自论文原文
  • 用零样本提示+段落丢弃机制动态判断是否要检索
  • 在8个模型上测试,多数情况表现最佳且上下文减少超30%
  • 适合资源有限的小模型,也帮强模型提速降开销

自适应检索增强生成旨在通过动态判断是否需要检索补充文本,缓解外部噪声干扰。然而,随着大语言模型对噪声的鲁棒性提升,自适应检索的必要性值得重新审视。本文提出AdaRankLLM框架,通过零样本提示结合段落丢弃机制构建自适应排序器,并与固定深度检索对比生成效果。为使小型开源模型具备精确的列表级重排序与自适应过滤能力,引入两阶段渐进式蒸馏方法,结合数据采样与增强技术。在三个数据集、八个LLM上的实验证明,AdaRankLLM在多数场景下性能最优,上下文开销显著降低。分析显示:对弱模型,它起关键噪声过滤作用;对强模型,则是高效的节能优化工具。

原文摘要 · Abstract (English)

Adaptive Retrieval-Augmented Generation aims to mitigate the interference of extraneous noise by dynamically determining the necessity of retrieving supplementary passages. However, as Large Language Models evolve with increasing robustness to noise, the necessity of adaptive retrieval warrants re-evaluation. In this paper, we rethink this necessity and propose AdaRankLLM, a novel adaptive retrieval framework. To effectively verify the necessity of adaptive listwise reranking, we first develop an adaptive ranker employing a zero-shot prompt with a passage dropout mechanism, and compare its generation outcomes against static fixed-depth retrieval strategies. Furthermore, to endow smaller open-source LLMs with this precise listwise ranking and adaptive filtering capability, we introduce a two-stage progressive distillation paradigm enhanced by data sampling and augmentation techniques. Extensive experiments across three datasets and eight LLMs demonstrate that AdaRankLLM consistently achieves optimal performance in most scenarios with significantly reduced context overhead. Crucially, our analysis reveals a role shift in adaptive retrieval: it functions as a critical noise filter for weaker models to overcome their limitations, while serving as a cost-effective efficiency optimizer for stronger reasoning models.

自适应检索大模型优化推理效率小模型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。