arXiv:2410.06866cs.CVeess.IV2024-10被引 3

提出防御视频质量评估模型对抗攻击的新框架。

Secure Video Quality Assessment Resisting Adversarial Attacks

  • 通过随机空间采样和守护图实现帧内防御。
  • 结合时序信息提升帧间抗扰能力,性能优于现有模型。
  • 适合关注视频质量评估安全性的研究者与工程师。

视频流量的指数级增长加剧了对视频质量评估(VQA)的需求。尽管当前先进的VQA模型已达到人类水平的准确率,但最新研究揭示了其对对抗攻击的脆弱性。为建立可靠且实用的评估系统,亟需具备抗恶意攻击能力的VQA模型。然而,目前尚无相关研究。本文首次探索通用对抗防御原则,旨在为现有VQA模型注入安全性。具体而言,我们引入视频帧内的随机空间网格采样实现帧内防御;设计基于守护图的像素级随机化,全局中和对抗扰动;同时提取视频序列的时序信息作为帧间防御补偿。基于上述原则,我们提出面向安全性的新型VQA框架SecureVQA。大量实验表明,SecureVQA在保持优异性能的同时,树立了安全新基准。消融实验进一步验证了各机制的泛化性与对主流VQA模型安全性的贡献。

原文摘要 · Abstract (English)

The exponential surge in video traffic has intensified the imperative for Video Quality Assessment (VQA). Leveraging cutting-edge architectures, current VQA models have achieved human-comparable accuracy. However, recent studies have revealed the vulnerability of existing VQA models against adversarial attacks. To establish a reliable and practical assessment system, a secure VQA model capable of resisting such malicious attacks is urgently demanded. Unfortunately, no attempt has been made to explore this issue. This paper first attempts to investigate general adversarial defense principles, aiming at endowing existing VQA models with security. Specifically, we first introduce random spatial grid sampling on the video frame for intra-frame defense. Then, we design pixel-wise randomization through a guardian map, globally neutralizing adversarial perturbations. Meanwhile, we extract temporal information from the video sequence as compensation for inter-frame defense. Building upon these principles, we present a novel VQA framework from the security-oriented perspective, termed SecureVQA. Extensive experiments indicate that SecureVQA sets a new benchmark in security while achieving competitive VQA performance compared with state-of-the-art models. Ablation studies delve deeper into analyzing the principles of SecureVQA, demonstrating their generalization and contributions to the security of leading VQA models.

视频质量评估对抗攻击安全框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。