arXiv:2604.05995cs.CLcs.AI2026-04ACL

发现大模型编辑后只是表面配合,内部记忆未真正更新。

The Model Agreed, But Didn't Learn: Diagnosing Surface Compliance in Large Language Models

论文配图:The Model Agreed, But Didn't Learn: Diagnosing Surface Compliance in Large Language Models
图 1 · 摘自论文原文
  • 用上下文学习测试模型自我评估能力,检测记忆修改真伪。
  • 多数编辑仅表面符合输出,内部信念未真正改变。
  • 反复编辑会累积记忆残留,导致不可逆的认知混乱。

大型语言模型(LLMs)将世界知识内化为参数化记忆,但不可避免地继承训练语料的过时与错误。确保这些内部表征的可靠性和可塑性,对可信部署至关重要。知识编辑提供了一种无需重新训练即可精准修改记忆的范式。然而,尽管当前编辑器在标准基准上表现优异,其依赖特定提示评估输出的评测框架是否能真实验证记忆修改仍存疑。本文提出一种简单诊断框架,通过在上下文学习(ICL)环境下进行判别性自我评估,更贴近真实应用场景,以捕捉记忆修改带来的细微行为变化。该探测揭示了普遍存在的表面合规现象:编辑器通过模仿目标输出获得高分,却未真正重构内部信念。此外,我们发现递归修改会积累表征残留,引发认知不稳定性,并永久削弱模型记忆状态的可逆性。这些发现警示了现有编辑范式的风险,凸显了构建可信、可持续的长期大模型系统中稳健记忆修改的关键作用。代码已公开于 https://github.com/XiaojieGu/SA-MCQ。

原文摘要 · Abstract (English)

Large Language Models (LLMs) internalize vast world knowledge as parametric memory, yet inevitably inherit the staleness and errors of their source corpora. Consequently, ensuring the reliability and malleability of these internal representations is imperative for trustworthy real-world deployment. Knowledge editing offers a pivotal paradigm for surgically modifying memory without retraining. However, while recent editors demonstrate high success rates on standard benchmarks, it remains questionable whether current evaluation frameworks that rely on assessing output under specific prompting conditions can reliably authenticate genuine memory modification. In this work, we introduce a simple diagnostic framework that subjects models to discriminative self-assessment under in-context learning (ICL) settings that better reflect real-world application environments, specifically designed to scrutinize the subtle behavioral nuances induced by memory modifications. This probing reveals a pervasive phenomenon of Surface Compliance, where editors achieve high benchmark scores by merely mimicking target outputs without structurally overwriting internal beliefs. Moreover, we find that recursive modifications accumulate representational residues, triggering cognitive instability and permanently diminishing the reversibility of the model's memory state. These insights underscore the risks of current editing paradigms and highlight the pivotal role of robust memory modification in building trustworthy, long-term sustainable LLM systems. Code is available at https://github.com/XiaojieGu/SA-MCQ.

大模型知识编辑记忆一致性表面合规

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。