arXiv:2502.16368cs.CV2025-02被引 11

让文生图模型在生成时即时擦除不想要的视觉概念。

Concept Corrector: Erase concepts on the fly for text-to-image diffusion models

  • 通过分析生成图像的视觉特征,在中间步骤检测并清除目标概念。
  • 无需修改模型参数,仅需提供要删除的概念和替代内容即可实现擦除。
  • 首次基于中间生成图像实现动态擦除,适用于多种违规内容消除场景。

文生图扩散模型存在生成不当内容(如色情元素)的风险。为解决此问题,研究提出概念擦除任务,旨在移除模型可能生成的特定概念。以往方法多聚焦输入端文本,但受限于提示词泛化能力,常导致擦除不彻底。本文提出Concept Corrector,从输出端图像入手,利用特定时间步的生成图像视觉特征检测目标概念,并引入概念移除注意力机制进行特征清除。该方法无需修改模型参数,仅需目标概念与替换内容即可实现即插即用式擦除,克服了现有方法无法处理已生成概念或依赖输入词的局限。实验表明,该方法在多种概念上均展现出出色的擦除效果,是首个基于中间生成图像实现动态擦除的方法。

原文摘要 · Abstract (English)

Text-to-image diffusion models have demonstrated the underlying risk of generating various unwanted content, such as sexual elements. To address this issue, the task of concept erasure has been introduced, aiming to erase any undesired concepts that the models can generate. Previous methods, whether training-based or training-free, have primarily focused on the input side, i.e., texts. However, they often suffer from incomplete erasure due to limitations in the generalization from limited prompts to diverse image content. In this paper, motivated by the notion that concept erasure on the output side, i.e., generated images, may be more direct and effective, we propose Concept Corrector. It checks target concepts based on visual features provided by final generated images predicted at certain time steps. Further, it incorporates Concept Removal Attention to erase generated concept features. It overcomes the limitations of existing methods, which are either unable to remove the concept features that have been generated in images or rely on the assumption that the related concept words are contained in input prompts. In the whole pipeline, our method changes no model parameters and only requires a given target concept as well as the corresponding replacement content, which is easy to implement. To the best of our knowledge, this is the first erasure method based on intermediate-generated images, achieving the ability to erase concepts on the fly. The experiments on various concepts demonstrate its impressive erasure performance.

文生图概念擦除扩散模型即时修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。