让扩散模型一键删除指定概念,还能保持生成质量。
EraseAnything++: Enabling Concept Erasure in Rectified Flow Transformers Leveraging Multi-Object Optimization
- 把删概念变成多目标优化问题,兼顾清除与保留生成能力。
- 在图像和视频上均超越旧方法,视频时序一致性显著提升。
- 适合需要内容净化或个性化控制的AI生成使用者。
从大规模文本到图像(T2I)和文本到视频(T2V)扩散模型中移除不需要的概念,同时保持生成质量,仍是重大挑战,尤其当现代模型如Stable Diffusion v3、Flux和OpenSora采用流匹配(flow-matching)和基于Transformer的架构,并扩展至长时序视频生成时。现有概念擦除方法针对早期T2I/T2V模型设计,难以泛化至这些新范式。为此,我们提出EraseAnything++,一个统一框架,用于在具有流匹配目标的图像与视频扩散模型中实现概念擦除。核心在于将概念擦除建模为约束型多目标优化问题,显式平衡概念移除与生成效用的保留。为解决冲突目标,我们引入一种高效的保用无学习策略,基于隐式梯度手术。结合LoRA参数调优与注意力级正则化,方法锚定在关键视觉表征上,并在空间与时间维度上一致传播擦除效果。在视频场景中,进一步通过锚定-传播机制,在参考帧初始化擦除,并在后续Transformer层中强制执行,从而缓解时间漂移。在图像与视频基准上的大量实验表明,EraseAnything++在擦除有效性、生成保真度与时间一致性方面显著优于先前方法,确立了新一代扩散模型中概念擦除的新基准。
原文摘要 · Abstract (English)
Removing undesired concepts from large-scale text-to-image (T2I) and text-to-video (T2V) diffusion models while preserving overall generative quality remains a major challenge, particularly as modern models such as Stable Diffusion v3, Flux, and OpenSora employ flow-matching and transformer-based architectures and extend to long-horizon video generation. Existing concept erasure methods, designed for earlier T2I/T2V models, often fail to generalize to these paradigms. To address this issue, we propose EraseAnything++, a unified framework for concept erasure in both image and video diffusion models with flow-matching objectives. Central to our approach is formulating concept erasure as a constrained multi-objective optimization problem that explicitly balances concept removal with preservation of generative utility. To solve the resulting conflicting objectives, we introduce an efficient utility-preserving unlearning strategy based on implicit gradient surgery. Furthermore, by integrating LoRA-based parameter tuning with attention-level regularization, our method anchors erasure on key visual representations and propagates it consistently across spatial and temporal dimensions. In the video setting, we further enhance consistency through an anchor-and-propagate mechanism that initializes erasure on reference frames and enforces it throughout subsequent transformer layers, thereby mitigating temporal drift. Extensive experiments on both image and video benchmarks demonstrate that EraseAnything++ substantially outperforms prior methods in erasure effectiveness, generative fidelity, and temporal consistency, establishing a new state of the art for concept erasure in next-generation diffusion models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。