arXiv:2606.10298cs.AIcs.CL2026-06被引 2

让大模型在引用外部信息时自动识别并处理知识冲突,提升生成可靠性。

From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs

论文配图:From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs
图 1 · 摘自论文原文
  • 根据上下文与模型先验的冲突信号动态分配权重,不再盲目信任外部信息。
  • 新方法使模型在错误上下文下仍能保持正确性,抵抗能力提升至16-33。
  • 适用于需要高可信生成的场景,如医疗、法律等专业领域应用。

当大语言模型基于检索或增强的上下文生成内容时,外部上下文与模型内在先验之间的知识冲突仍是影响可靠性的核心瓶颈。现有对比解码方法采用‘上下文感知’范式,单方面放大上下文而忽略模型先验,导致在上下文错误时覆盖正确的先验知识。本文提出‘冲突感知’新范式,依据冲突信号动态分配上下文与先验的权威性,而非预设上下文可信。研究发现,先验与上下文对数概率的仿射组合构成具有固有‘模式不对称性’的幂函数族:外推会无界放大正确先验的误差,插值则在上下文正确时纠正不足;静态模式无法兼顾两者。现有方法多属此类,以外推为主。为此,我们提出TriState-Bench,一种模型感知的评估协议,通过校准各模型的先验知识,量化三种冲突状态:修正、抵抗与一致。为解决不对称问题,提出自适应模式路由(ARR),每步动态切换模式,将抵抗性能的EM值从低于6提升至16–33,同时不牺牲修正与一致能力。代码已开源。

原文摘要 · Abstract (English)

When large language models generate from retrieved or augmented contexts, conflicts between external context and parametric priors remain a central reliability bottleneck. Existing contrastive decoding methods follow a \emph{context-aware} paradigm that unilaterally amplifies context over parametric priors, overwriting correct priors when the context is erroneous. We generalize this to the \textbf{conflict-aware} paradigm that dynamically allocates authority between prior and context based on conflict signals, rather than presupposing context trustworthiness. We show that the affine combination of prior and context logits yields a \textbf{power family} with an inherent \textbf{regime asymmetry}: extrapolation amplifies errors unboundedly when the prior is correct, interpolation under-corrects when the context is correct, and no static regime covers both. Existing contrastive decoding methods are instances of this family, mostly extrapolative. To evaluate both conflict directions, we propose TriState-Bench, a model-aware evaluation protocol that calibrates per-model prior knowledge to measure three conflict states: correction, resistance, and agreement. To resolve the asymmetry, we propose Adaptive Regime Routing (ARR), which routes between regimes at each step, lifting resistance EM from below 6 to 16--33 without sacrificing correction or agreement. Our code is available at https://github.com/keith-Jiang/conflict-aware-decoding.

大模型知识冲突解码优化可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。