arXiv:2410.09140cs.CV2024-10被引 16

通过挖掘相关概念,精准清除模型中的敏感内容知识。

RealEra: Semantic-level Concept Erasure via Neighbor-Concept Mining

  • 引入邻居概念挖掘,扩大删除范围以消除关联输入生成的残留内容。
  • 在扩展删除范围的同时,保持无关概念生成质量不受影响。
  • 适合关注生成模型安全、隐私保护的研究者与开发者。

文本到图像生成模型的快速发展带来了肖像权侵犯和不当内容生成等安全问题。概念擦除技术旨在移除模型对受保护或不适当概念的知识。尽管已有方法尝试平衡擦除效果与特定性,但面对语义相关输入时仍会产生大量残留生成内容。本文提出 RealEra 解决这一“概念残留”问题。首先引入邻居概念挖掘机制,通过对目标概念嵌入添加随机扰动,挖掘出相关概念,从而扩展擦除范围,消除通过关联概念输入生成的内容。为进一步缓解擦除范围扩大对无关概念生成的负面影响,RealEra 采用超越概念正则化,保留无关概念的空间位置,维持其正常生成性能。此外,通过闭式解优化 U-Net 的交叉注意力权重,并结合 LoRA 模块实现预测噪声对齐。在多个基准测试上的实验表明,RealEra 在擦除效果、特定性和泛化能力上均优于现有方法。

原文摘要 · Abstract (English)

The remarkable development of text-to-image generation models has raised notable security concerns, such as the infringement of portrait rights and the generation of inappropriate content. Concept erasure has been proposed to remove the model's knowledge about protected and inappropriate concepts. Although many methods have tried to balance the efficacy (erasing target concepts) and specificity (retaining irrelevant concepts), they can still generate abundant erasure concepts under the steering of semantically related inputs. In this work, we propose RealEra to address this "concept residue" issue. Specifically, we first introduce the mechanism of neighbor-concept mining, digging out the associated concepts by adding random perturbation into the embedding of erasure concept, thus expanding the erasing range and eliminating the generations even through associated concept inputs. Furthermore, to mitigate the negative impact on the generation of irrelevant concepts caused by the expansion of erasure scope, RealEra preserves the specificity through the beyond-concept regularization. This makes irrelevant concepts maintain their corresponding spatial position, thereby preserving their normal generation performance. We also employ the closed-form solution to optimize weights of U-Net for the cross-attention alignment, as well as the prediction noise alignment with the LoRA module. Extensive experiments on multiple benchmarks demonstrate that RealEra outperforms previous concept erasing methods in terms of superior erasing efficacy, specificity, and generality. More details are available on our project page https://realerasing.github.io/RealEra/ .

概念擦除生成安全扩散模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。