arXiv:2508.18235cs.CV2025-08被引 1

用知识蒸馏消除扩散模型中的文本后门,不损失生成质量

Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation

  • 通过跨注意力引导的知识蒸馏,精准清除后门关联
  • 对像素级后门消除率达100%,风格攻击达93%
  • 适合关注生成模型安全的开发者和研究者

文生图扩散模型虽推动了生成式AI发展,但易受后门攻击。攻击者可在训练数据中注入难以察觉的文本触发词,导致模型生成被操控的内容。尽管分类模型已有成熟文本后门防御方法,生成模型仍缺乏有效应对策略。本文提出自知识蒸馏结合跨注意力引导(SKD-CAG)的方法,通过保留模型在无触发词时的正常输出能力,引导其修正受污染提示下的错误响应。利用跨注意力机制在注意力层面中和后门影响,实现对恶意关联的精准清除。大量实验表明,该方法在像素级后门攻击中实现100%消除率,在风格类攻击中达93%,且未牺牲图像保真度或鲁棒性。结果表明,针对性遗忘是保障生成模型安全的有效路径。代码与模型权重见:https://github.com/Mystic-Slice/Sealing-The-Backdoor。

原文摘要 · Abstract (English)

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to generate manipulated outputs. Although text-based backdoor defenses in classification models are well-explored, generative models lack effective mitigation techniques against. We address this by selectively erasing the model's learned associations between adversarial text triggers and poisoned outputs, while preserving overall generation quality. Our approach, Self-Knowledge Distillation with Cross-Attention Guidance (SKD-CAG), uses knowledge distillation to guide the model in correcting responses to poisoned prompts while maintaining image quality by exploiting the fact that the backdoored model still produces clean outputs in the absence of triggers. Using the cross-attention mechanism, SKD-CAG neutralizes backdoor influences at the attention level, ensuring the targeted removal of adversarial effects. Extensive experiments show that our method outperforms existing approaches, achieving removal accuracy 100\% for pixel backdoors and 93\% for style-based attacks, without sacrificing robustness or image fidelity. Our findings highlight targeted unlearning as a promising defense to secure generative models. Code and model weights can be found at https://github.com/Mystic-Slice/Sealing-The-Backdoor .

扩散模型后门防御知识蒸馏生成安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。