arXiv:2506.05278cs.CLcs.AI2025-06中稿 · ACL被引 2

通过细粒度动作分解,解决大模型检索生成中的知识冲突问题

Micro-Act: Mitigating Knowledge Conflict in LLM-based RAG via Actionable Self-Reasoning

  • 设计分层动作空间,自动拆解知识源为可执行推理步骤
  • 在5个数据集上显著提升问答准确率,尤其在时序与语义冲突场景
  • 既解决冲突又保持非冲突问题性能,适合真实场景应用

检索增强生成(RAG)系统常因外部检索知识与大语言模型(LLM)内嵌参数知识冲突而性能下降,影响问答等下游任务。现有方法多采用并列对比两源知识,但冗长上下文易淹没模型判断力。为此,我们提出Micro-Act框架,通过分层动作空间自动感知上下文复杂度,并将每源知识自适应分解为一系列细粒度比较动作。这些动作以可执行步骤形式呈现,支持超越表面信息的深层推理。在五个基准数据集上的大量实验表明,Micro-Act在全部5个数据集和3种冲突类型下均显著优于当前最优基线,尤其在时序与语义冲突场景中,所有基线均表现不佳;更重要的是,其在非冲突问题上也保持稳健表现,凸显其在真实RAG应用中的实用价值。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) systems commonly suffer from Knowledge Conflicts, where retrieved external knowledge contradicts the inherent, parametric knowledge of large language models (LLMs). It adversely affects performance on downstream tasks such as question answering (QA). Existing approaches often attempt to mitigate conflicts by directly comparing two knowledge sources in a side-by-side manner, but this can overwhelm LLMs with extraneous or lengthy contexts, ultimately hindering their ability to identify and mitigate inconsistencies. To address this issue, we propose Micro-Act a framework with a hierarchical action space that automatically perceives context complexity and adaptively decomposes each knowledge source into a sequence of fine-grained comparisons. These comparisons are represented as actionable steps, enabling reasoning beyond the superficial context. Through extensive experiments on five benchmark datasets, Micro-Act consistently achieves significant increase in QA accuracy over state-of-the-art baselines across all 5 datasets and 3 conflict types, especially in temporal and semantic types where all baselines fail significantly. More importantly, Micro-Act exhibits robust performance on non-conflict questions simultaneously, highlighting its practical value in real-world RAG applications.

知识冲突RAG推理机制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。