提出新方法让大模型编辑知识时不破坏推理逻辑。
Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing
- 分离推理与知识注入,用掩码路径避免冲突
- 多跳问答任务上性能超越现有方法
- 适合需要精准知识更新的场景
知识编辑旨在不重新训练整个模型的情况下,高效更新大型语言模型(LLMs)中的特定知识。在上下文编辑(ICE)方法中,通过将新知识直接注入输入上下文实现轻量级更新,保持模型参数不变。然而,现有方法未显式分离新注入知识与模型原有推理过程,导致外部更新与内部参数化知识之间产生冲突,影响推理路径的一致性和准确性。本文通过初步实验发现,模型的推理路径与其内部知识紧密耦合,若不调整推理路径而直接注入新信息,尤其在多跳任务中常导致性能下降。为此,我们提出DecKER框架,通过生成掩码推理路径,并结合混合检索与基于模型的验证来解决知识编辑问题。在多跳问答基准测试中,DecKER显著优于现有ICE方法,有效缓解知识冲突并保持推理一致性。代码已开源:https://github.com/bebr2/DecKER。
原文摘要 · Abstract (English)
Knowledge editing aims to efficiently update Large Language Models (LLMs) by modifying specific knowledge without retraining the entire model. Among knowledge editing approaches, in-context editing (ICE) offers a lightweight solution by injecting new knowledge directly into the input context, leaving model parameters unchanged. However, existing ICE approaches do not explicitly separate the newly injected knowledge from the model's original reasoning process. This entanglement often results in conflicts between external updates and internal parametric knowledge, undermining the consistency and accuracy of the reasoning path.In this work, we conduct preliminary experiments to examine how parametric knowledge influences reasoning path planning. We find that the model's reasoning is tightly coupled with its internal knowledge, and that naively injecting new information without adapting the reasoning path often leads to performance degradation, particularly in multi-hop tasks. To this end, we propose DecKER, a novel ICE framework that decouples reasoning from knowledge editing by generating a masked reasoning path and then resolving knowledge edits via hybrid retrieval and model-based validation. Experiments on multi-hop QA benchmarks show that DecKER significantly outperforms existing ICE methods by mitigating knowledge conflicts and preserving reasoning consistency. Our code is available at: https://github.com/bebr2/DecKER .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。