首次揭示一致性模型易受后门攻击,触发后生成特定图像。
How to Backdoor Consistency Models?
- 用随机噪声作触发器,隐蔽性强且适配模型采样过程。
- 无害生成时FID接近正常模型,触发后精准输出目标图像。
- 适用于安全评估与对抗鲁棒性研究者,警示模型潜在风险。
一致性模型通过直接将噪声映射到数据实现一步生成,显著加速采样过程。然而其对对抗攻击的鲁棒性尚未深入研究。本文首次系统探究一致性模型在后门攻击下的脆弱性。不同于以往针对扩散模型的定制化训练方式,本工作针对一致性模型独特的训练机制设计攻击框架。实验表明,在从高斯噪声采样时,中毒模型生成图像的弗雷歇起始距离(FID)与干净模型相当;一旦触发,模型则生成指定后门目标图像。我们测试了多种触发器与目标配置,包括以随机噪声作为视觉不明显、难以检测的触发器,该设计契合一致性模型的采样流程。所有条件下,攻击均成功实现高实用性与高特异性。攻击的隐蔽性源于一致性模型特性与噪声触发器的隐匿性。代码已公开于 https://github.com/chengenw/backdoorCM。
原文摘要 · Abstract (English)
Consistency models are a new class of models that generate images by directly mapping noise to data, allowing for one-step generation and significantly accelerating the sampling process. However, their robustness against adversarial attacks has not yet been thoroughly investigated. In this work, we conduct the first study on the vulnerability of consistency models to backdoor attacks. While previous research has explored backdoor attacks on diffusion models, those studies have primarily focused on conventional diffusion models, employing a customized backdoor training process and objective, whereas consistency models have distinct training processes and objectives. Our proposed framework demonstrates the vulnerability of consistency models to backdoor attacks. During image generation, poisoned consistency models produce images with a Fréchet Inception Distance (FID) comparable to that of a clean model when sampling from Gaussian noise. However, once the trigger is activated, they generate backdoor target images. We explore various trigger and target configurations to evaluate the vulnerability of consistency models, including the use of random noise as a trigger. This novel trigger is visually inconspicuous, more challenging to detect, and aligns well with the sampling process of consistency models. Across all configurations, our framework successfully compromises the consistency models while maintaining high utility and specificity. We also examine the stealthiness of our proposed attack, which is attributed to the unique properties of consistency models and the elusive nature of the Gaussian noise trigger. Our code is available at \href{https://github.com/chengenw/backdoorCM}{https://github.com/chengenw/backdoorCM}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。