arXiv:2509.06472cs.IR2025-09

用大模型内部状态判断检索结果可信度,提升问答准确率。

Rethinking LLM Parametric Knowledge as Post-retrieval Confidence for Dynamic Retrieval and Reranking

  • 基于模型隐藏状态构建置信度检测模型
  • 检索后重排序准确率提升23.7%,检索成本降41%
  • 适合需要高可靠问答的场景

大型语言模型在面对超出知识范围的问题时常产生错误回答(幻觉)。检索增强生成(RAG)通过引入外部知识缓解此问题,但关键挑战在于判断检索到的上下文是否真正提升了模型的回答能力。现有方法依赖离散标签或有限信号,未能充分挖掘模型内部连续隐藏状态中的丰富信息。为此,我们提出一种新型后检索知识过滤方法:首先基于模型隐藏状态构建置信度检测模型,量化检索内容对模型信心的提升;利用该模型构建偏好数据集(NQ_Rerank),微调重排序器,使其在重排序时优先选择下游模型偏好的上下文;此外,提出基于置信度的动态检索(CBDR),根据模型对原始问题的初始置信度自适应触发检索,减少知识冲突并提高效率。实验表明,该方法在上下文筛选和端到端 RAG 性能上均有显著提升,检索成本降低 41%,同时保持竞争力的准确性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical challenge remains: determining whether retrieved contexts effectively enhance the model`s ability to answer specific queries. This challenge underscores the importance of knowledge boundary awareness, which current methods-relying on discrete labels or limited signals-fail to address adequately, as they overlook the rich information in LLMs` continuous internal hidden states. To tackle this, we propose a novel post-retrieval knowledge filtering approach. First, we construct a confidence detection model based on LLMs` internal hidden states to quantify how retrieved contexts enhance the model`s confidence. Using this model, we build a preference dataset (NQ_Rerank) to fine-tune a reranker, enabling it to prioritize contexts preferred by the downstream LLM during reranking. Additionally, we introduce Confidence-Based Dynamic Retrieval (CBDR), which adaptively triggers retrieval based on the LLM`s initial confidence in the original question, reducing knowledge conflicts and improving efficiency. Experimental results demonstrate significant improvements in accuracy for context screening and end-to-end RAG performance, along with a notable reduction in retrieval costs while maintaining competitive accuracy.

大模型检索增强置信度RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。