arXiv:2512.14341cs.CVcs.AI2025-12TPAMI被引 3

提出可跨模型防御恶意图像编辑的新框架,提升图像免疫能力。

Towards Transferable Defense Against Malicious Image Edits

  • 联合优化图像与文本,增强对未知编辑模型的抗性。
  • 通过梯度正则化使扰动趋向平坦极小点,提升鲁棒性。
  • 适合关注生成模型安全、对抗攻击防御的研究者。

近期基于输入图像中不可察觉扰动的方法在应对基于扩散模型的恶意图像编辑方面展现出良好潜力。然而,现有方法在跨模型评估中转移能力有限。为此,本文提出可迁移防御恶意图像编辑(TDAE)框架,通过协同图像-文本优化提升图像对恶意编辑的免疫力。视觉防御层面,引入平梯度防御机制(FDM),将梯度正则化融入对抗目标,显式引导扰动向平坦极小点移动,从而增强对未见编辑模型的鲁棒性。文本增强保护方面,提出动态提示防御(DPD),周期性优化文本嵌入,使免疫图像的编辑结果与原始图像一致,并在此基础上更新图像。通过迭代对抗更新多样化嵌入,DPD促使免疫图像学习更广泛免疫特征,实现跨模型迁移。大量实验表明,TDAE在模型内与跨模型评估中均达到当前最优性能。

原文摘要 · Abstract (English)

Recent approaches employing imperceptible perturbations in input images have demonstrated promising potential to counter malicious manipulations in diffusion-based image editing systems. However, existing methods suffer from limited transferability in cross-model evaluations. To address this, we propose Transferable Defense Against Malicious Image Edits (TDAE), a novel bimodal framework that enhances image immunity against malicious edits through coordinated image-text optimization. Specifically, at the visual defense level, we introduce FlatGrad Defense Mechanism (FDM), which incorporates gradient regularization into the adversarial objective. By explicitly steering the perturbations toward flat minima, FDM amplifies immune robustness against unseen editing models. For textual enhancement protection, we propose an adversarial optimization paradigm named Dynamic Prompt Defense (DPD), which periodically refines text embeddings to align the editing outcomes of immunized images with those of the original images, then updates the images under optimized embeddings. Through iterative adversarial updates to diverse embeddings, DPD enforces the generation of immunized images that seek a broader set of immunity-enhancing features, thereby achieving cross-model transferability. Extensive experimental results demonstrate that our TDAE achieves state-of-the-art performance in mitigating malicious edits under both intra- and cross-model evaluations.

图像安全扩散模型对抗防御跨模型迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。