arXiv:2512.19134cs.CLcs.IR2025-12ACL被引 7

用预训练语料统计量替代模型自信度,动态触发检索防幻觉。

QuCo-RAG: Quantifying Uncertainty from the Pre-training Corpus for Dynamic Retrieval-Augmented Generation

  • 基于预训练语料中的实体频率与共现,量化生成时的不确定性
  • 多跳问答任务上比顶尖基线提升5-12点准确率,跨模型最高增14点
  • 不依赖模型内部信号,适用于未知预训练数据的主流大模型

动态检索增强生成通过自适应决定生成过程中的检索时机来缓解大语言模型的幻觉问题。然而,现有方法依赖模型内部信号(如概率输出、熵值),这些信号因大模型通常存在校准偏差,常在错误输出上表现出高置信度而不可靠。本文提出QuCo-RAG,将判断依据从主观置信度转向基于预训练语料的客观统计。该方法分两阶段量化不确定性:(1) 生成前,识别低频实体以指示长尾知识缺口;(2) 生成中,验证实体在预训练语料中的共现情况,零共现往往预示幻觉风险。两个阶段均利用Infini-gram实现对4万亿词元的毫秒级查询,在不确定性高时触发检索。在多跳问答基准测试中,使用OLMo-2模型的QuCo-RAG相比最先进基线获得5–12个百分点的精确率提升,并能有效迁移至未公开预训练数据的模型(Llama-3、Qwen2.5、GPT-4.1/5-chat),最高提升达14个百分点。在长文本生成与生物医学问答任务中也展现出良好泛化能力。结果确立了语料根基的验证机制作为一项原则性强、实际模型无关的动态RAG范式。代码已公开于https://github.com/ZhishanQ/QuCo-RAG。

原文摘要 · Abstract (English)

Dynamic Retrieval-Augmented Generation adaptively determines when to retrieve during generation to mitigate hallucinations in large language models (LLMs). However, existing methods rely on model-internal signals (e.g., logits, entropy), which are fundamentally unreliable because LLMs are typically ill-calibrated and often exhibit high confidence in erroneous outputs. We propose QuCo-RAG, which shifts from subjective confidence to objective statistics computed from pre-training data. Our method quantifies uncertainty through two stages: (1) before generation, we identify low-frequency entities indicating long-tail knowledge gaps; (2) during generation, we verify entity co-occurrence in the pre-training corpus, where zero co-occurrence often signals hallucination risk. Both stages leverage Infini-gram for millisecond-latency queries over 4 trillion tokens, triggering retrieval when uncertainty is high. Experiments on multi-hop QA benchmarks show QuCo-RAG achieves EM gains of 5--12 points over state-of-the-art baselines with OLMo-2 models, and transfers effectively to models with undisclosed pre-training data (Llama-3, Qwen2.5, GPT-4.1/5-chat), improving EM by up to 14 points. Generalization to long-form generation and biomedical QA further validates the robustness of our paradigm. These results establish corpus-grounded verification as a principled, practically model-agnostic paradigm for dynamic RAG. Our code is publicly available at https://github.com/ZhishanQ/QuCo-RAG.

动态RAG幻觉抑制不确定性量化预训练语料

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。