SITA通过结构隐性扰动实现高效且不可察觉的风格攻击,保护艺术作品不被滥用。
SITA: Structurally Imperceptible and Transferable Adversarial Attacks for Stylized Image Generation
- 利用CLIP引导去风格化损失,破坏图像的鲁棒风格特征
- 无需替代扩散模型,计算开销低,跨模型迁移能力更强
- 在视觉质量不变前提下隐藏扰动,适合版权保护场景
图像生成技术虽推动多领域进步,但也引发数据滥用与版权争议,尤其在视觉艺术创作方面。现有防御方法常依赖对抗攻击,但存在迁移性差、计算成本高、引入明显噪声等问题,影响原作美学质量。为此,本文提出结构隐性且可迁移的对抗攻击方法SITA。SITA采用基于CLIP的去风格化损失,解耦并破坏图像的鲁棒风格表示,阻碍风格提取过程,从而干扰风格化生成。该方法无需使用替代扩散模型,显著降低计算开销。其对风格特征的鲁棒破坏确保了跨模型强迁移性。同时,扰动嵌入图像的不可察觉结构细节中,有效防止风格提取而不损害视觉质量。大量实验表明,SITA在迁移性、计算效率和噪声不可感知性方面均显著优于现有方法。代码已公开于https://github.com/A-raniy-day/SITA。
原文摘要 · Abstract (English)
Image generation technology has brought significant advancements across various fields but has also raised concerns about data misuse and potential rights infringements, particularly with respect to creating visual artworks. Current methods aimed at safeguarding artworks often employ adversarial attacks. However, these methods face challenges such as poor transferability, high computational costs, and the introduction of noticeable noise, which compromises the aesthetic quality of the original artwork. To address these limitations, we propose a Structurally Imperceptible and Transferable Adversarial (SITA) attacks. SITA leverages a CLIP-based destylization loss, which decouples and disrupts the robust style representation of the image. This disruption hinders style extraction during stylized image generation, thereby impairing the overall stylization process. Importantly, SITA eliminates the need for a surrogate diffusion model, leading to significantly reduced computational overhead. The method's robust style feature disruption ensures high transferability across diverse models. Moreover, SITA introduces perturbations by embedding noise within the imperceptible structural details of the image. This approach effectively protects against style extraction without compromising the visual quality of the artwork. Extensive experiments demonstrate that SITA offers superior protection for artworks against unauthorized use in stylized generation. It significantly outperforms existing methods in terms of transferability, computational efficiency, and noise imperceptibility. Code is available at https://github.com/A-raniy-day/SITA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。