提出通用防御框架,让不同生成模型协同抗攻击。
Architecture-Agnostic Feature Synergy for Universal Defense Against Heterogeneous Generative Threats
- 通过特征空间对齐实现跨架构防御,无需复杂校正。
- 40次迭代内达90%以上防护效果,抗扰动能力强。
- 可扩展至未知模型,适合安全检测与内容审核场景。
生成式AI部署带来前所未有的内容安全与隐私挑战。现有防御方法多针对特定架构(如扩散模型或GAN),形成脆弱的“防御孤岛”,难以应对异构生成威胁。本文发现,简单像素级集成策略存在根本性优化障碍:由于目标函数差异,异构生成器的像素梯度在统计上正交,导致破坏性干扰。基于此,我们观察到尽管底层机制不同,生成内容的高层特征表示在跨架构间具有一致性。据此提出架构无关的目标特征协同(ATFS)框架,通过引入目标引导图像,将多模型防御重构为统一的特征空间对齐任务,实现内在梯度对齐,无需复杂修正。大量实验表明,ATFS在异构场景(如扩散模型+GAN)中达到当前最优防护性能,40次迭代内超过90%效果,且在严苛扰动预算下仍保持强攻击能力。该框架通过更换特征提取器即可无缝扩展至未见架构(如VQ-VAE),对JPEG压缩和缩放也表现出鲁棒性。计算高效轻量,为打破防御孤岛、实现通用生成安全提供可行路径。代码与模型已开源,便于复现。
原文摘要 · Abstract (English)
Generative AI deployment poses unprecedented challenges to content safety and privacy. However, existing defense mechanisms are often tailored to specific architectures (e.g., Diffusion Models or GANs), creating fragile "defense silos" that fail against heterogeneous generative threats. This paper identifies a fundamental optimization barrier in naive pixel-space ensemble strategies: due to divergent objective functions, pixel-level gradients from heterogeneous generators become statistically orthogonal, causing destructive interference. To overcome this, we observe that despite disparate low-level mechanisms, high-level feature representations of generated content exhibit alignment across architectures. Based on this, we propose the Architecture-Agnostic Targeted Feature Synergy (ATFS) framework. By introducing a target guidance image, ATFS reformulates multi-model defense as a unified feature space alignment task, enabling intrinsic gradient alignment without complex rectification. Extensive experiments show ATFS achieves SOTA protection in heterogeneous scenarios (e.g., Diffusion+GAN). It converges rapidly, reaching over 90% performance within 40 iterations, and maintains strong attack potency even under tight perturbation budgets. The framework seamlessly extends to unseen architectures (e.g., VQ-VAE) by switching the feature extractor, and demonstrates robust resistance to JPEG compression and scaling. Being computationally efficient and lightweight, ATFS offers a viable pathway to dismantle defense silos and enable universal generative security. Code and models are open-sourced for reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。