用文本控制扩散模型生成高质量无限制对抗样本
VENOM: Text-driven Unrestricted Adversarial Example Generation with Diffusion Models
- 将图像生成与对抗攻击统一在反向扩散过程中
- 在不牺牲成功率的前提下提升图像质量
- 适合研究模型漏洞与防御机制的学者
对抗攻击通过细微修改输入图像有效欺骗机器学习模型,近年来受到广泛关注。传统方法将扰动限制在 $l_p$-范数范围内,而无限制对抗样本(UAE)允许更复杂的生成式操纵。扩散模型因稳定性和图像质量优于生成对抗网络(GANs),现成为生成 UAE 的主流方法。然而,现有基于扩散模型的 UAE 方法依赖参考图像,难以直接从随机噪声生成自然对抗样本(NAE),常导致输出失控或失真。本文提出 VENOM,首个文本驱动的扩散模型无限制对抗样本生成框架。VENOM 将图像内容生成与对抗合成统一于单一反向扩散过程,实现高保真度对抗样本且不降低攻击成功率(ASR)。为稳定该过程,引入带动量的自适应对抗引导策略,确保生成样本 $x^*$ 符合自然图像分布 $p(x)$。大量实验表明,VENOM 在攻击成功率和图像质量上均优于现有方法,显著推进了对抗样本生成技术,并为模型漏洞分析与防御改进提供重要洞见。
原文摘要 · Abstract (English)
Adversarial attacks have proven effective in deceiving machine learning models by subtly altering input images, motivating extensive research in recent years. Traditional methods constrain perturbations within $l_p$-norm bounds, but advancements in Unrestricted Adversarial Examples (UAEs) allow for more complex, generative-model-based manipulations. Diffusion models now lead UAE generation due to superior stability and image quality over GANs. However, existing diffusion-based UAE methods are limited to using reference images and face challenges in generating Natural Adversarial Examples (NAEs) directly from random noise, often producing uncontrolled or distorted outputs. In this work, we introduce VENOM, the first text-driven framework for high-quality unrestricted adversarial examples generation through diffusion models. VENOM unifies image content generation and adversarial synthesis into a single reverse diffusion process, enabling high-fidelity adversarial examples without sacrificing attack success rate (ASR). To stabilize this process, we incorporate an adaptive adversarial guidance strategy with momentum, ensuring that the generated adversarial examples $x^*$ align with the distribution $p(x)$ of natural images. Extensive experiments demonstrate that VENOM achieves superior ASR and image quality compared to prior methods, marking a significant advancement in adversarial example generation and providing insights into model vulnerabilities for improved defense development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。