arXiv:2504.08411cs.CVcs.AI2025-04被引 3

用知识引导对抗噪声,让伪造图像在语义上混乱难辨。

A Knowledge-guided Adversarial Defense for Resisting Malicious Visual Manipulation

  • 在特定领域知识层面生成对抗噪声,干扰伪造模型语义输出。
  • 相比现有方法,提升感知质量和对恶意篡改的防御力。
  • 适合关注图像安全与伪造检测的研究者和应用开发者。

视觉伪造的恶意应用已对多个领域的用户安全与声誉构成严重威胁。近年来,基于对抗噪声的防御方法备受关注,但仅依赖数据的方法往往在低层特征空间扭曲假样本,难以在高层语义空间有效应对恶意篡改。前沿研究表明,融入深度学习中的知识可带来更可靠、泛化性更强的解决方案。受此启发,我们提出知识引导的对抗防御(KGAD),旨在主动使恶意篡改模型输出语义混淆的样本。具体而言,在生成对抗噪声时,我们聚焦于在领域特定知识层面构建显著的语义混淆,并采用与视觉感知密切相关的度量指标,替代通用的像素级指标。生成的对抗噪声能通过触发知识引导与感知相关的干扰,主动破坏伪造样本。为验证有效性,我们在人类感知与视觉质量评估上进行定性和定量实验。结果表明,无论在何种任务下,该方法均优于当前最优方法,并展现出优异的泛化能力。

原文摘要 · Abstract (English)

Malicious applications of visual manipulation have raised serious threats to the security and reputation of users in many fields. To alleviate these issues, adversarial noise-based defenses have been enthusiastically studied in recent years. However, ``data-only" methods tend to distort fake samples in the low-level feature space rather than the high-level semantic space, leading to limitations in resisting malicious manipulation. Frontier research has shown that integrating knowledge in deep learning can produce reliable and generalizable solutions. Inspired by these, we propose a knowledge-guided adversarial defense (KGAD) to actively force malicious manipulation models to output semantically confusing samples. Specifically, in the process of generating adversarial noise, we focus on constructing significant semantic confusions at the domain-specific knowledge level, and exploit a metric closely related to visual perception to replace the general pixel-wise metrics. The generated adversarial noise can actively interfere with the malicious manipulation model by triggering knowledge-guided and perception-related disruptions in the fake samples. To validate the effectiveness of the proposed method, we conduct qualitative and quantitative experiments on human perception and visual quality assessment. The results on two different tasks both show that our defense provides better protection compared to state-of-the-art methods and achieves great generalizability.

对抗防御图像伪造知识引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。