LLM在多步推理中因新旧知识冲突导致性能下降,且越更新越差。
Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge
- 设计新基准TRACK,模拟真实世界中的多轮知识冲突场景。
- 实验证明:新增事实越多,模型推理错误率越高,甚至比不更新更差。
- 适用于研究知识更新机制的可信度与复杂推理任务的鲁棒性。
现有方法通过上下文注入或知识编辑来缓解大语言模型(LLMs)中的过时信息问题,但当更新知识未能覆盖模型参数化知识时,会引发知识冲突,并传播至错误推理。当前评估基准多局限于单次知识更新和事实回忆,未考察其对下游推理的影响。本文提出TRACK(Testing Reasoning Amid Conflicting Knowledge),一个涵盖三个推理密集型场景(WIKI、CODE、MATH)的新基准,引入多重现实冲突以反映真实复杂性。实验结果表明,在提供更新事实的情况下,模型表现反而劣于未提供更新的情况,且随着更新事实数量增加,性能退化加剧。该失败既源于无法准确整合新知识,也源于即使知识已整合,推理过程仍存在缺陷。TRACK为衡量和推动多步推理中冲突知识传播的研究提供了严谨基准。
原文摘要 · Abstract (English)
A common solution for mitigating outdated or incorrect information in Large Language Models (LLMs) is to provide updated facts in-context or through knowledge editing. However, these methods introduce knowledge conflicts when the knowledge update fails to overwrite the model's parametric knowledge, which propagate to faulty reasoning. Current benchmarks for this problem, however, largely focus only on single knowledge updates and fact recall without evaluating how these updates affect downstream reasoning. In this work, we introduce TRACK (Testing Reasoning Amid Conflicting Knowledge), a new benchmark for studying how LLMs propagate new knowledge through multi-step reasoning when it conflicts with the model's initial parametric knowledge. Spanning three reasoning-intensive scenarios (WIKI, CODE, and MATH), TRACK introduces multiple, realistic conflicts to mirror real-world complexity. Our results on TRACK reveal that providing updated facts to models for reasoning can worsen performance compared to providing no updated facts to a model, and that this performance degradation exacerbates as more updated facts are provided. We show this failure stems from both inability to faithfully integrate updated facts, but also flawed reasoning even when knowledge is integrated. TRACK provides a rigorous new benchmark to measure and guide future progress on propagating conflicting knowledge in multi-step reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。