arXiv:2607.20433cs.CLcs.AI2026-07

让模型自动生成编辑数据,避免知识更新时能力退化。

Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing

论文配图:Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing
图 1 · 摘自论文原文
  • 用模型自身解码分布采样生成编辑数据,替代外部语料
  • 在Qwen3-8B上批量编辑2万次后,数学推理准确率仍保持79.9%
  • 无需外部数据,可直接接入现有编辑工具,适合部署场景

语言模型训练完成后世界持续变化,知识编辑成为替代全量重训的关键方法,但其部署受限于核心能力退化:数学与编程推理严重下降,而百科记忆保持完好。我们发现这种不对称退化源于分布不匹配——基于协方差的编辑器仅保留参考语料覆盖的子空间,无法捕捉微调(SFT)和人类偏好对齐(DPO)后的操作分布。静态外部语料(如Wikipedia或预训练混合数据)无法恢复这一偏移的流形。为此提出Moir,通过从模型自身解码分布采样直接估计保留协方差 $C$。以单个随机词元作为生成种子,绕过指令跟随模板,暴露模型内部化的更广子空间。Moir无需外部数据,可无缝嵌入任意基于协方差的编辑器。在OLMo-2、Llama-3.1和Qwen-3(7-8B)上,无论MEMIT或AlphaEdit,批处理与顺序编辑模式下,均显著提升脆弱领域保真度。尤其在Qwen3-8B经20,000次AlphaEdit批量编辑后,GSM8K准确率从基准的10.9%提升至79.9%。结果表明,使保留分布与模型实际操作分布对齐是无损编辑的关键,且模型自身可能是部署系统中最易获取的分布来源。

原文摘要 · Abstract (English)

While language models remain frozen at their training state, the world evolves continuously. Knowledge editing has emerged as a key alternative to full retraining, but its deployment is bottlenecked by the erosion of core capabilities: mathematical and programmatic reasoning collapse while encyclopedic recall remains intact. We trace this asymmetric degradation to a distributional mismatch. Covariance-based editors preserve only the subspaces spanned by their reference corpus, but fail to capture the operative distribution shaped by post-training such as SFT and DPO. Static external corpora, including Wikipedia and even the original pretraining mixture, cannot recover this shifted manifold. We propose Moir, which estimates the preservation covariance $C$ directly from the model itself by sampling from its own decoding distribution. Seeding generation with a single random vocabulary token bypasses the instruction-following templates that otherwise dominate sampled outputs, exposing the broader subspaces the model has internalized. Moir requires no external data and serves as a drop-in component for any covariance-based editor, a practical advantage given that the pre- and post-training corpora of most modern LLMs are not publicly accessible. Across OLMo-2, Llama-3.1, and Qwen-3 (7-8B), under both MEMIT and AlphaEdit and in batch and sequential regimes, Moir consistently extends preservation in the most vulnerable domains, most strikingly on Qwen3-8B after 20,000 AlphaEdit batch edits, it retains 79.9% GSM8K accuracy compared to 10.9% with the Wikipedia baseline. These results suggest that aligning the preservation distribution with the model's operative distribution is a key factor in non-destructive editing, and that the model itself may be the most accessible source of that distribution for deployed systems.

知识编辑无损更新模型自生成推理保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。