arXiv:2604.05876cs.CL2026-04

提出机制化电路编辑方法,让大模型能用修改的知识进行多步推理。

Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models

论文配图:Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models
图 1 · 摘自论文原文
  • 基于因果电路识别定位知识存储与推理路径
  • 在真实多跳推理任务中实现90%以上的编辑成功率
  • 适合需要精准知识更新的高可靠场景

将大语言模型部署于动态现实环境时,需持续更新其预训练知识。现有知识编辑方法虽可修复孤立事实,但常存在‘推理断层’:模型能回忆修改后的事实,却无法将其用于多步推理链。分析表明,多跳推理依赖于超越直接事实召回的稀疏电路结构,不同功能组件分别负责中间处理与最终答案预测。为此,我们提出MCircKE(机制化电路基知识编辑)框架,通过映射-适配流程实现精准编辑:首先识别特定推理任务的因果电路,涵盖事实存储与逻辑传递路径;随后仅在该映射电路内手术式更新参数。在MQuAKE系列基准上的大量实验表明,该方法显著提升知识编辑在多跳推理中的有效性。

原文摘要 · Abstract (English)

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from a \textit{reasoning gap}, where the model recalls the edited fact but fails to utilize it in multi-step reasoning chains. Our analysis shows that multi-hop reasoning relies on sparse circuitry beyond direct factual recall, with functionally differentiated components contributing to intermediate processing and final-answer prediction. To bridge this gap, we introduce MCircKE (\underline{M}echanistic \underline{Circ}uit-based \underline{K}nowledge \underline{E}diting), a mechanistically grounded framework that enables a map-and-adapt editing procedure. MCircKE first identifies the causal circuits responsible for a specific reasoning task, capturing both the storage of the fact and the routing of its logical consequences. It then surgically update parameters exclusively within this mapped circuit. Extensive experiments on the MQuAKE-series benchmarks demonstrate the effectiveness of the proposed method for multi-hop reasoning in knowledge editing.

知识编辑推理增强机制解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。