提出更高效安全的扩散模型概念擦除方法,防止敏感内容被恶意恢复。
Rethinking Robust Adversarial Concept Erasure in Diffusion Models
- 用单样本语义引导生成对抗嵌入,提升概念空间覆盖精度
- 在多个数据集上实现顶尖擦除鲁棒性与图像生成质量
- 计算成本远低于现有方法,适合实际部署
概念擦除旨在移除扩散模型中的特定不安全概念,同时保持图像生成能力。为应对擦除后概念易被对抗攻击恢复的问题,现有对抗性擦除方法在鲁棒性与计算开销间存在权衡。原因在于其使用少量随机样本近似对抗目标函数,难以准确捕获目标概念空间。为此,我们提出语义引导对抗优化(SGAO),仅用单一样本即可生成更精准的对抗嵌入。同时提出语义引导概念擦除(SGCE),自动将目标概念映射至语义相似的替代概念。在不适宜工作内容、艺术风格和物体相关概念上的大量实验表明,所提方法S-GRACE在擦除鲁棒性和图像生成性能上均达到当前最优,且计算成本显著降低。代码已公开于https://github.com/Qhong-522/S-GRACE。
原文摘要 · Abstract (English)
Concept erasure methods aim to remove specific unsafe target concepts in diffusion models while preserving image generation utility. To address the vulnerability that erased concepts can be easily recovered under adversarial attacks, adversarial concept erasure methods integrate adversarial optimization into the concept erasure process. However, existing adversarial concept erasure methods face a trade-off between robustness and computational cost. We attribute this to adversarial optimization techniques that use random samples to approximate the adversarial objective function. Adversarial optimization that uses a small number of samples fails to produce adversarial embeddings that accurately capture the target concept space. To mitigate this limitation, we propose Semantic-Guided Adversarial Optimization, which uses a single sample to produce adversarial embeddings that better capture the target concept space. We also propose Semantic-Guided Concept Erasure, which automatically maps the target concept to a semantically similar surrogate. Extensive experiments on not-safe-for-work content, artistic styles, and object-related concepts demonstrate that our method, S-GRACE (Semantic-Guided Robust Adversarial Concept Erasure) achieves state-of-the-art erasure robustness and superior image generation utility, with significantly lower computational cost than existing methods. Our code is available at https://github.com/Qhong-522/S-GRACE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。