发现现有概念删除技术只是暂时压制,而非真正消除生成能力。
Erased or Dormant? Rethinking Concept Erasure Through Reversibility
- 通过轻量微调测试被删概念是否可重激活,评估删除彻底性。
- 实验显示被删概念仅需少量调整即可高保真重现。
- 适用于关注模型安全与可控性的研究人员和开发者。
当前概念删除技术在文本到图像扩散模型中,是真正消除了目标概念的生成能力,还是仅实现了表面的提示特定抑制?本文系统评估了两种代表性方法——统一概念编辑与已擦除稳定扩散——在实例级别上的鲁棒性与可逆性。通过轻量级微调,检验被删除概念的重激活潜力。定量与定性分析表明,被删除的概念在极小适应后仍能以较高视觉保真度恢复生成,说明现有方法仅抑制潜在生成表示,并未彻底消除。研究揭示了现有技术的关键局限,强调需进行更深层次的表示级干预和更严格的评估标准,以实现概念的真正、不可逆删除。
原文摘要 · Abstract (English)
To what extent does concept erasure eliminate generative capacity in diffusion models? While prior evaluations have primarily focused on measuring concept suppression under specific textual prompts, we explore a complementary and fundamental question: do current concept erasure techniques genuinely remove the ability to generate targeted concepts, or do they merely achieve superficial, prompt-specific suppression? We systematically evaluate the robustness and reversibility of two representative concept erasure methods, Unified Concept Editing and Erased Stable Diffusion, by probing their ability to eliminate targeted generative behaviors in text-to-image models. These methods attempt to suppress undesired semantic concepts by modifying internal model parameters, either through targeted attention edits or model-level fine-tuning strategies. To rigorously assess whether these techniques truly erase generative capacity, we propose an instance-level evaluation strategy that employs lightweight fine-tuning to explicitly test the reactivation potential of erased concepts. Through quantitative metrics and qualitative analyses, we show that erased concepts often reemerge with substantial visual fidelity after minimal adaptation, indicating that current methods suppress latent generative representations without fully eliminating them. Our findings reveal critical limitations in existing concept erasure approaches and highlight the need for deeper, representation-level interventions and more rigorous evaluation standards to ensure genuine, irreversible removal of concepts from generative models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。