arXiv:2501.14999cs.CV2025-01被引 6

用扩散模型净化视频对抗样本,提升识别鲁棒性。

VideoPure: Diffusion-based Adversarial Purification for Video Recognition

  • 引入时空一致的扩散反演与引导优化,逐步去除噪声。
  • 在多个攻击类型下优于现有防御方法,尤其对自适应攻击有效。
  • 适合需要高安全性的视频识别系统开发者使用。

近期研究表明,视频识别模型易受对抗样本攻击,威胁下游应用安全。然而现有研究多集中于攻击方法,防御机制仍不充分。由于视频具有时空复杂性,现有防御方法存在成本高、过拟合及性能有限等问题。尽管扩散模型在图像领域已实现良好防御效果,但直接应用于视频时因时间维度导致性能与效率下降。为此,本文提出首个基于扩散模型的视频净化框架 VideoPure。给定对抗样本后,先通过时间DDIM反演将其转化为时空一致且轨迹明确的分布,保留视频结构的同时覆盖对抗噪声;随后在DDIM去噪过程中,利用每一步中间结果进行引导式时空优化,有效清除对抗噪声并保持时序一致性;最后将优化后的多步中间结果输入识别模型进行投票预测类别。我们在基准数据集和模型上评估了该方法对黑盒、灰盒及自适应攻击的防御能力,结果表明其整体防御性能优于其他净化方法。代码已开源:https://github.com/deep-kaixun/VideoPure。

原文摘要 · Abstract (English)

Recent work indicates that video recognition models are vulnerable to adversarial examples, posing a serious security risk to downstream applications. However, current research has primarily focused on adversarial attacks, with limited work exploring defense mechanisms. Furthermore, due to the spatial-temporal complexity of videos, existing video defense methods face issues of high cost, overfitting, and limited defense performance. Recently, diffusion-based adversarial purification methods have achieved robust defense performance in the image domain. However, due to the additional temporal dimension in videos, directly applying these diffusion-based adversarial purification methods to the video domain suffers performance and efficiency degradation. To achieve an efficient and effective video adversarial defense method, we propose the first diffusion-based video purification framework to improve video recognition models' adversarial robustness: VideoPure. Given an adversarial example, we first employ temporal DDIM inversion to transform the input distribution into a temporally consistent and trajectory-defined distribution, covering adversarial noise while preserving more video structure. Then, during DDIM denoising, we leverage intermediate results at each denoising step and conduct guided spatial-temporal optimization, removing adversarial noise while maintaining temporal consistency. Finally, we input the list of optimized intermediate results into the video recognition model for multi-step voting to obtain the predicted class. We investigate the defense performance of our method against black-box, gray-box, and adaptive attacks on benchmark datasets and models. Compared with other adversarial purification methods, our method overall demonstrates better defense performance against different attacks. Our code is available at https://github.com/deep-kaixun/VideoPure.

视频防御扩散模型对抗样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。