arXiv:2602.02028cs.AI2026-02

让AI通过多步推理学习新知识,而非死记硬背事实。

Edit Knowledge, Not Just Facts via Multi-Step Reasoning over Background Stories

  • 用连贯背景故事引入新知识,使其与旧知识形成逻辑关联。
  • 训练时生成需多步推理的自问问题,强化知识融合能力。
  • 通过知识蒸馏让模型内化推理过程,适合需动态更新的场景。

使人工智能系统,尤其是大语言模型,在推理过程中更新并灵活运用知识,仍是核心挑战。现有知识编辑方法侧重原子事实,虽提升事实召回率,但常无法将更新信息融入可跨情境使用的连贯框架。本文认为知识更新本质上是推理问题,而非记忆问题。因此,模型应在新信息对任务解决至关重要的情境下进行训练,结合已有知识,并通过多步推理加以实践。基于此,我们提出三项训练原则:首先,新知识以连贯背景故事形式呈现,解释其与已有知识的关系;其次,使用自生成的多跳问题进行训练,要求模型结合新信息进行多步推理;第三,采用知识蒸馏,使学生模型在无新信息访问的情况下内化教师模型的推理行为。实验表明,经此策略训练的模型能有效利用新知识进行推理,在需要整合多个新事实的复杂问题上表现优异。

原文摘要 · Abstract (English)

Enabling artificial intelligence systems, particularly large language models, to update knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts, improving factual recall but often failing to integrate updated information into a coherent framework usable across contexts. In this work, we argue that knowledge update is fundamentally a reasoning problem rather than a memorization problem. Consequently, a model should be trained in situations where the new information is instrumental to solving a task, combined with pre-existing knowledge, and exercised through multi-step reasoning. Based on this insight, we propose a training strategy based on three principles. First, new knowledge is introduced as a coherent background story that contextualizes novel facts and explains their relation to existing knowledge. Second, models are trained using self-generated multi-hop questions that require multi-step reasoning involving the new information. Third, training is done using knowledge distillation, forcing a student model to internalize the teacher's reasoning behavior without access to the novel information. Experiments show that models trained with this strategy effectively leverage newly acquired knowledge during reasoning and achieve remarkable performance on challenging questions that require combining multiple new facts.

知识更新多步推理知识蒸馏大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。