arXiv:2605.25765cs.CVcs.AI2026-05

通过激活投影实现扩散模型概念删除,不重训练且效果更优。

Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models

论文配图:Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models
图 1 · 摘自论文原文
  • 用去噪过程中的交叉注意力激活构建遗忘与保留基底
  • 在十类概念上显著降低改写提示的泄漏,保持原模型表现
  • 适合需要精准删减特定内容的生成模型应用

概念删除旨在不重新训练的前提下,从预训练文本到图像扩散模型中移除目标概念。闭式方法因其仅需一次确定性权重修改且无推理开销而备受青睐。然而,现有方法依赖文本编码器对少数锚定提示的响应来表征目标概念,导致未明示概念的改写提示可绕过编辑。本文提出PURE(U-Net渲染中的投影擦除),基于短去噪轨迹中各层交叉注意力激活构建遗忘与保留基底,并对交叉注意力键值权重施加单一线性投影。在涵盖艺术风格、知识产权、名人及NSFW类别的十个概念的综合评估基准上,PURE在改写和对抗性提示下显著降低目标泄漏,同时保持保留概念性能接近原始模型,整体遗忘-保留权衡优于所有对比方法。

原文摘要 · Abstract (English)

Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention weights and add no inference-time cost. Existing closed-form methods, however, represent the target concept through the text encoder's response to a few short anchor prompts that name it, and paraphrased prompts that evoke the concept without naming it consistently bypass the edit. We argue that the target should instead be represented in the cross-attention activation space. Text embeddings describe the user's prompt, while cross-attention activations describe what the model is about to render, and the latter generalize to paraphrase the anchor templates do not cover. Building on this observation, we propose PURE (Projection in U-Net Rendering for Erasure), a closed-form method that builds the forget and retain bases from per-layer cross-attention activations captured along a short denoising trajectory and applies a single linear projector to the cross-attention key and value weights. On a recent holistic concept-unlearning benchmark covering ten concepts across artistic style, intellectual property, celebrity, and NSFW categories, PURE significantly reduces target leakage under paraphrased and adversarial prompts while preserving retain concepts close to the unedited model, yielding the best overall forget-retain trade-off among evaluated methods.

扩散模型概念删除AI安全图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。