arXiv:2506.18428cs.AIcs.LG2025-06被引 1

模型编辑在微调后常失效,需警惕安全风险与修复需求

How Robust is Model Editing after Fine-Tuning? An Empirical Study on Text-to-Image Diffusion Models

  • 测试多种编辑与微调组合,发现编辑大多无法保留
  • DoRA微调导致编辑失效最严重,UCE编辑更持久
  • 提醒需重编辑以维持模型安全对齐,适合安全研究者

模型编辑是一种低成本修正预训练模型行为的技术,可用于事实修正和偏见缓解。然而,编辑是否在微调后仍有效尚不明确。本文系统研究文本到图像扩散模型中编辑与微调的交互关系,涵盖两个模型家族(Stable Diffusion、FLUX)、两种主流编辑方法及三种微调技术(DreamBooth、LoRA、DoRA)。实验覆盖多样编辑任务与评估指标,结果表明:无论微调是否相关,编辑普遍无法持续存在。尤其,DoRA微调导致最强编辑反转效应;而Uce编辑方法相比ReFACT更具鲁棒性,微调后仍保持更高效力。该发现揭示当前编辑技术的关键局限,强调需开发更可靠的长期控制手段。这对AI安全具有双重意义:微调可作为清除恶意编辑的机制,但也需重新编辑以维护有益的安全属性。

原文摘要 · Abstract (English)

Model editing offers a low-cost technique to inject or correct a particular behavior in a pre-trained model without extensive retraining, supporting applications such as factual correction and bias mitigation. Despite this common practice, it remains unknown whether edits persist after fine-tuning or whether they are inadvertently reversed. This question has fundamental practical implications. For example, if fine-tuning removes prior edits, it could serve as a defence mechanism against hidden malicious edits. Vice versa, the unintended removal of edits related to bias mitigation could pose serious safety concerns. We systematically investigate the interaction between model editing and fine-tuning in the context of T2I diffusion models, which are known to exhibit biases and generate inappropriate content. Our study spans two T2I model families (Stable Diffusion and FLUX), two sota editing techniques, and three fine-tuning methods (DreamBooth, LoRA, and DoRA). Through an extensive empirical analysis across diverse editing tasks and evaluation metrics, our findings reveal a trend: edits generally fail to persist through fine-tuning, even when fine-tuning is tangential or unrelated to the edits. Notably, we observe that DoRA exhibits the strongest edit reversal effect. At the same time, among editing methods, UCE demonstrates greater robustness, retaining significantly higher efficacy post-fine-tuning compared to ReFACT. These findings highlight a crucial limitation in current editing methodologies, emphasizing the need for more robust techniques to ensure reliable long-term control and alignment of deployed AI systems. These findings have dual implications for AI safety: they suggest that fine-tuning could serve as a remediation mechanism for malicious edits while simultaneously highlighting the need for re-editing after fine-tuning to maintain beneficial safety and alignment properties.

模型编辑扩散模型微调安全对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。