arXiv:2606.20245cs.AI2026-06被引 1

让大模型自己识别并解决知识冲突,提升推理可靠性。

Navigating Unreliable Parametric and Contextual Knowledge: Explicit Knowledge Conflict Resolution for LLM Inference

论文配图:Navigating Unreliable Parametric and Contextual Knowledge: Explicit Knowledge Conflict Resolution for LLM Inference
图 1 · 摘自论文原文
  • 用语义熵评估模型自信度,动态决定调用内部或外部知识
  • 多智能体协作分析冲突并生成可解释的解决方案
  • 在多个基准上超越现有方法,适合需要高可靠性的应用

大语言模型(LLMs)通过结合内部参数化知识和上下文学习能力,在多种语言任务中表现优异。然而,外部信息引入可能引发内部知识与外部内容间,或多个外部上下文间的冲突。现有方法通常假设一方可靠,仅选择其一,未主动解决矛盾。为此,本文提出MACR框架,采用多智能体推理机制,实现显式冲突解析。首先基于改进的语义熵测量,评估模型对回答的置信度,并据此选择性地将内部知识外化或检索外部知识;随后通过三个专用智能体——规则归纳、冲突分析与不一致解决——协同处理所有可用上下文。实验表明,MACR在多个基准上显著优于当前最优基线,且能提供可解释的冲突解决过程。

原文摘要 · Abstract (English)

Large language models (LLMs) have achieved strong performance across a wide range of language-based tasks by leveraging both extensive parametric knowledge and in-context learning ability, enabling them to incorporate external information provided in the input prompt. However, the integration of external knowledge can introduce conflicts, not only between the model's internal parametric knowledge and the external information, but also among multiple pieces of external contexts. Existing approaches typically assume that either the model or the provided context is reliable, overlooking the possibility that both sources may contain errors, and avoid conflicts by privileging one source over the other, rather than actively resolving inconsistencies. To address these limitations, we propose a novel framework MACR for LLM knowledge conflict resolution that moves beyond the conventional binary choice paradigm and incorporates an explicit conflict-resolution mechanism based on a multi-agent reasoning approach. Specifically, we first propose an adaptive knowledge assessment and retrieval approach that employs a modified semantic entropy measure to quantify an LLM's confidence in its answer to a given query. Based on this confidence estimation, MACR either externalizes the model's internal knowledge as textual representations or retrieves relevant external knowledge when internal knowledge is insufficient, generating basic contexts for subsequent reasoning. Then we introduce an inductive multi-agent reasoning framework with three specialized agents that, respectively, induce explicit rules, analyze potential conflicts, and resolve inconsistencies across all available contexts. Empirical results demonstrate that MACR significantly outperforms state-of-the-art baselines across benchmarks, while also providing interpretable resolutions of explicit conflicts.

大模型推理知识冲突多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。