arXiv:2606.00432cs.LG2026-06

通过概率融合提升RAG生成的准确性,让模型更依赖检索结果。

Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG

论文配图:Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG
图 1 · 摘自论文原文
  • 构建双分布融合机制,同时考虑完整RAG和仅检索信息的分布。
  • 在ALCE、Natural Questions等数据集上,事实准确率显著优于标准RAG。
  • 无需训练,适配需要高可信度生成的场景,如问答与摘要。

随着检索增强生成(RAG)系统规模扩大,确保生成内容忠实于外部证据变得愈发困难。大语言模型在冲突时仍可能优先使用参数化知识而非检索信息。本文提出一种无需训练的解码框架「Grounded Decoding」,旨在不修改模型参数的前提下提升RAG的事实一致性。该方法在每一步生成中构建两个匹配提示的分布:(1) 基于查询、检索文档和已生成前缀的完整RAG分布;(2) 仅基于检索证据和相同前缀的纯检索分布。最终词元分布通过概率单纯形上的KL巴里中心目标求解,实现两分布的归一化几何融合。该形式自然退化为标准RAG(当锚定权重为0时),并随锚定强度增加逐步将概率质量向检索证据转移。进一步引入冲突感知自适应加权机制,动态依据分布分歧与检索器置信度调整锚定强度。在ALCE、Natural Questions和FActScore上的实验表明,该方法在事实准确性和引用质量上持续优于标准RAG及竞争性解码基线,同时保持生成流畅性。结果表明,概率级融合为忠实RAG解码提供了一种强大且高效的替代方案。

原文摘要 · Abstract (English)

As retrieval-augmented generation (RAG) systems scale, it becomes increasingly challenging to ensure faithful grounding in external evidence. Large language models may still prioritize parametric knowledge over retrieved information when conflicts arise. We propose a novel training-free decoding framework, \emph{Grounded Decoding}, designed to improve factual consistency in RAG without modifying model parameters. Unlike standard approaches that rely on a single conditional distribution, our method constructs two matched-prompt distributions at every generation step: (1) a full RAG distribution conditioned on the query, retrieved documents, and generated prefix, and (2) a retrieval-only distribution conditioned solely on retrieved evidence and the same prefix. The final next-token distribution is derived as the unique solution to a KL-barycenter objective over the probability simplex, yielding a normalized geometric fusion of the two distributions.This formulation naturally recovers standard RAG when the grounding weight is zero and smoothly shifts probability mass toward retrieved evidence as grounding strength increases. We further introduce a conflict-aware adaptive weighting scheme that dynamically adjusts grounding based on distributional disagreement and retriever confidence. Experiments on ALCE, Natural Questions, and FActScore demonstrate consistent improvements in factual accuracy and citation quality over standard RAG and competitive decoding-time baselines, while maintaining fluency. Our results indicate that probability-level fusion provides a strong and efficient alternative to logit-level intervention methods for faithful RAG decoding.

RAG生成质量概率融合忠实生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。