arXiv:2607.00570cs.CL2026-07

解决多文档检索中信息冲突问题,提升答案准确性。

Dual-Confidence Contrastive Decoding for Retrieval-Augmented Generation

论文配图:Dual-Confidence Contrastive Decoding for Retrieval-Augmented Generation
图 1 · 摘自论文原文
  • 利用文档级与词元级双重置信度筛选可信文本
  • 在企业级事实问答测试中显著优于现有方法
  • 无需训练,适合需要精准引用的场景

检索增强生成(RAG)在面对多篇检索文档时,常因部分来源无关、过时或矛盾而影响回答质量。现有对比解码方法主要处理模型内部记忆与外部上下文之间的冲突,本文则关注多文档内部的上下文冲突问题。为此,我们提出基于企业深度研究场景构建的DRQA基准,其答案基于无法从模型内部记忆中恢复的企业特定事实。进一步提出无训练的双置信度对比解码(DCCD),结合文档级置信度(判断文档是否足以回答问题)与词元级置信度(判断该文档是否支持下一步的确定性预测),通过双重置信度信号选择正负样本流,并按置信度差值缩放文档级对比强度。在DRQA及标准多文档问答基准上,DCCD在全上下文与对比解码基线中表现最优,尤其在DRQA上提升最大。结果表明,在检索证据存在内在冲突时,源感知且置信度门控的解码至关重要。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) increasingly requires models to answer questions from multiple retrieved documents, where only some sources are relevant and the retrieved bundle may contain stale, noisy, or conflicting evidence. Existing contrastive decoding methods primarily focus on resolving conflicts between the model's internal memory and the retrieved context. In contrast, we study the complementary problem of intra-context conflict in multi-document RAG. To evaluate this setting, we introduce DRQA, a factual-conflict question answering benchmark derived from enterprise deep-research scenarios, where answers are grounded in synthetic enterprise-specific facts that are designed not to be recoverable from the model's internal memory. We further propose Dual-Confidence Contrastive Decoding (DCCD), a training-free decoding method that combines document-level confidence, which estimates whether a document appears sufficient for answering the question, with token-level confidence, which estimates whether that document supports a confident next-token prediction. DCCD selects positive and negative document-conditioned streams using these dual-confidence signals and scales a document-level contrast by their confidence margin. Across DRQA and standard multi-document QA benchmarks, DCCD achieves the best average performance among full-context and contrastive decoding baselines, with the largest gains on DRQA. These results highlight the importance of source-aware, confidence-gated decoding when retrieved evidence is internally conflicting.

RAG多文档问答对比解码置信度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。