提出轻量级方法量化大模型知识纠缠,预测编辑引发的意外行为扩散。
CLaRE-ty Amid Chaos: Quantifying Representational Entanglement to Predict Ripple Effects in LLM Editing
- 基于单层前向激活计算知识间纠缠度,无需反向传播。
- 在1.1万条事实上构建大规模纠缠图,预测效果比基线提升62.2%。
- 速度快2.74倍、显存少2.85倍,适合模型编辑审计与评估。
大语言模型的静态知识表示会随时间过时或出错。虽然模型编辑技术可修正事实关联,但常引发不可预测的涟漪效应——即未预期的行为变化传播至隐藏空间。本文提出CLaRE,一种轻量级表示层面的方法,用于识别涟漪效应可能发生的位置。不同于以往依赖梯度的方法,CLaRE通过单个中间层的前向激活量化事实间的纠缠程度,避免昂贵的反向计算。为支持系统性研究,我们构建并分析了来自三个现有数据集的11,427条事实语料库。利用CLaRE,我们在多个模型上计算出大规模纠缠图,捕捉局部编辑如何在表示空间中传播。这些图可用于增强编辑保全集合、生成审计追踪、高效红队测试及可扩展的编辑后评估。相比基线,CLaRE在与涟漪效应的斯皮尔曼相关性上平均提升62.2%,速度提升2.74倍,峰值显存降低2.85倍,且所需存储仅为基线的一小部分。我们的纠缠图与语料库已开源于https://github.com/manitbaser/CLaRE。
原文摘要 · Abstract (English)
The static knowledge representations of large language models (LLMs) inevitably become outdated or incorrect over time. While model-editing techniques offer a promising solution by modifying a model's factual associations, they often produce unpredictable ripple effects, which are unintended behavioral changes that propagate even to the hidden space. In this work, we introduce CLaRE, a lightweight representation-level technique to identify where these ripple effects may occur. Unlike prior gradient-based methods, CLaRE quantifies entanglement between facts using forward activations from a single intermediate layer, avoiding costly backward passes. To enable systematic study, we prepare and analyse a corpus of 11,427 facts drawn from three existing datasets. Using CLaRE, we compute large-scale entanglement graphs of this corpus for multiple models, capturing how local edits propagate through representational space. These graphs enable stronger preservation sets for model editing, audit trails, efficient red-teaming, and scalable post-edit evaluation. In comparison to baselines, CLaRE achieves an average of 62.2% improvement in Spearman correlation with ripple effects while being $2.74\times$ faster, and using $2.85\times$ less peak GPU memory. Besides, CLaRE requires only a fraction of the storage needed by the baselines to compute and preserve fact representations. Our entanglement graphs and corpus are available at https://github.com/manitbaser/CLaRE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。