SPEED可快速精准擦除扩散模型中的100个概念,且不损害其他内容质量。
SPEED: Scalable, Precise, and Efficient Concept Erasure for Diffusion Models
- 直接修改模型参数,在不干扰非目标概念的前提下定位可编辑空间
- 5秒内完成100个概念擦除,非目标内容保留效果优于现有方法
- 适合需要高效隐私保护或版权合规的生成式AI应用
由于版权侵权、不当内容和隐私泄露等问题日益严重,从大规模文本到图像扩散模型中擦除特定概念变得愈发重要。在可扩展应用中,基于微调的方法虽精确但耗时,而实时编辑方法常因优化目标冲突导致非目标内容生成质量下降。为此,我们提出SPEED,一种直接编辑模型参数的高效概念擦除方法。SPEED通过搜索零空间(null space)——即参数更新不影响非目标概念的编辑空间——实现可扩展且精确的擦除。为促进零空间优化,引入三项互补策略:基于影响度的先验过滤(IPF)以选择性保留最受影响的非目标概念,定向先验增强(DPA)通过语义一致变体丰富保留集,不变等式约束(IEC)用于维持生成过程中的关键不变性。多任务评估表明,SPEED在保持非目标内容方面显著优于现有方法,同时实现高效且高保真度的概念擦除,仅用5秒即可成功擦除100个概念。代码与模型已开源:https://github.com/Ouxiang-Li/SPEED。
原文摘要 · Abstract (English)
Erasing concepts from large-scale text-to-image (T2I) diffusion models has become increasingly crucial due to the growing concerns over copyright infringement, offensive content, and privacy violations. In scalable applications, fine-tuning-based methods are time-consuming to precisely erase multiple target concepts, while real-time editing-based methods often degrade the generation quality of non-target concepts due to conflicting optimization objectives. To address this dilemma, we introduce SPEED, an efficient concept erasure approach that directly edits model parameters. SPEED searches for a null space, a model editing space where parameter updates do not affect non-target concepts, to achieve scalable and precise erasure. To facilitate accurate null space optimization, we incorporate three complementary strategies: Influence-based Prior Filtering (IPF) to selectively retain the most affected non-target concepts, Directed Prior Augmentation (DPA) to enrich the filtered retain set with semantically consistent variations, and Invariant Equality Constraints (IEC) to preserve key invariants during the T2I generation process. Extensive evaluations across multiple concept erasure tasks demonstrate that SPEED consistently outperforms existing methods in non-target preservation while achieving efficient and high-fidelity concept erasure, successfully erasing 100 concepts within only 5 seconds. Our code and models are available at: https://github.com/Ouxiang-Li/SPEED.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。