提出轻量级可适配的模型删忆方法,精准擦除敏感信息不重训练
RAZOR: Ratio-Aware Layer Editing for Targeted Unlearning in Vision Transformers and Diffusion Models
- 按遗忘贡献度筛选关键层和注意力头,分步精准编辑
- 在CLIP、Stable Diffusion等模型上实现高精度稳定擦除,量化后仍有效
- 比传统方法更快更省资源,适合实际部署中的安全删忆
基于Transformer的扩散模型与视觉语言模型取得了显著成功,但如何在不重新训练的前提下高效删除不良或敏感信息,仍是模型安全与合规的核心挑战。我们提出一种轻量、模型无关的删忆框架RAZOR(Ratio-Aware Zero/One-step Optimized Retentive unlearning),可将遗忘更新推广至Transformer骨干网络中的多层多头协同编辑。RAZOR通过测量各层与注意力头对目标数据遗忘的贡献度,识别出最关键组件,并采用受控正则化规则进行更新,避免损害整体性能。编辑范围逐步扩展,确保精准删忆而不过度修改或影响无关能力。我们在CLIP、Stable Diffusion及视觉语言模型(VLMs)上,基于涵盖身份、风格、物体擦除任务的主流删忆基准进行评估。结果表明,即使在量化条件下,RAZOR仍能实现高精度、稳定的遗忘效果,且保留能力更强、效率更高,运行速度显著快于传统方法。这证明RAZOR是适用于Transformer视觉模型的安全、可扩展删忆方案。
原文摘要 · Abstract (English)
Transformer based diffusion and vision-language models have achieved remarkable success; yet, efficiently removing undesirable or sensitive information without retraining remains a central challenge for model safety and compliance. We introduce Ratio-Aware Zero/One-step Optimized Retentive unlearning (RAZOR), a lightweight, model-agnostic unlearning framework that generalizes forgetting updates to coordinated multi-layer and multi-head edits within transformer backbones. RAZOR identifies the most important layers and attention heads by measuring how much they contribute to forgetting the target data while preserving useful knowledge. Then, it updates these parts of the model using a carefully regularized rule to avoid harming overall performance. The set of edited components grows gradually, ensuring precise unlearning without over-editing or damaging unrelated capabilities. We evaluate RAZOR on CLIP, Stable Diffusion, and vision-language models (VLMs) using widely adopted unlearning benchmarks covering identity, style, and object erasure tasks. Our results show that RAZOR achieves highly accurate and stable forgetting, even under quantization. This approach offers stronger retention and better efficiency than prior methods. Notably, it also operates significant faster than conventional techniques. These results demonstrate that RAZOR is a practical and scalable solution for safe, adaptive unlearning in transformer-based vision models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。