arXiv:2606.29090cs.CLcs.AI2026-06

让AI根据问题难易自动决定查多少资料,答得对不对自己也能判断。

AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering

论文配图:AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering
图 1 · 摘自论文原文
  • 按问题难度动态调整检索数量,不固定条数
  • 自信度估计准确区分正确与错误答案(高信57.6%对0%)
  • 无需重训练模型,适合各类大模型和闭源API

检索增强生成(RAG)已成为将大模型与外部知识结合的标准方法,但现有系统对所有问题均检索固定数量段落,导致简单问题浪费算力,复杂问题信息不足,且无法判断生成答案的可信度。随着越来越多问答系统基于商业语言模型API构建,一种无需重训练底层模型、可自主决定检索量并评估自身可信度的方法具有重要实用价值。本文提出AB-RAG(自适应预算检索增强生成),一个无需训练、兼容任意主干模型的框架:生成答案后,融合三种信号(模型自身确定性、答案与证据一致性、检索得分方差)估算置信度,并在固定检索预算内决定是否继续检索。对暴露词概率的模型直接读取确定性;对闭源API则通过自一致性近似,实现无内部访问也可用。在三个主干模型和两个数据集上,置信度估计能可靠区分正确与错误答案,在事实类数据集上,高信与低信答案的精确匹配率分别为57.6%和0%,实现清晰分离。自适应策略提升强模型性能,研究亦如实报告负面结果,如该信号对短答案无效,以及检索信号符号经测量后被修正。全实验仅使用一台消费级笔记本电脑和数美元API费用完成。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has become the standard way to ground large language models in external knowledge, yet most systems retrieve a fixed number of passages for every question regardless of its difficulty. This wastes computation on easy questions, starves hard ones, and gives no signal for when a generated answer can be trusted. With a growing share of question answering systems built on top of commercial language model APIs, a method that can decide how much to retrieve, and how far to trust its own answers, without retraining the underlying model, is of clear practical value. This paper presents AB-RAG (Adaptive Budgeted Retrieval-Augmented Generation), a training-free and backbone-agnostic framework that generates an answer, estimates its confidence from a combination of three signals, and then decides whether to stop or to retrieve more evidence, subject to a fixed retrieval budget. The estimator combines the model's own certainty, the agreement between the answer and the evidence, and the variance of the retrieval scores. For models that expose token probabilities the certainty signal is read directly; for closed APIs it is approximated by self-consistency, so the method works without access to model internals. Across three backbones and two datasets, the central result is that the confidence estimate reliably separates correct from incorrect answers on every backbone, reaching a clean split of 57.6% against 0% Exact Match between high- and low-confidence answers on a factoid dataset. The adaptive policy improves accuracy on capable backbones, and the study reports its negative and nuanced findings honestly, including a confidence signal that proved unsuitable for short answers and a retrieval signal whose sign was found and corrected through measurement. The entire study was carried out on a single consumer laptop with only a few dollars of API spend.

检索增强自适应置信度估计闭源模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。